-- Logs begin at Wed 2022-08-24 16:00:53 UTC, end at Wed 2022-08-24 17:01:03 UTC. -- Aug 24 16:30:53.810788 dv-cinder-779578-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 16:30:53.819471 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 16:30:53 2022] *** Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: nodename: dv-cinder-779578-5-iscsi Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: machine: x86_64 Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: clock source: unix Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: pcre jit disabled Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: detected number of CPU cores: 4 Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: current working directory: / Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: detected binary path: /usr/bin/uwsgi-core Aug 24 16:30:53.821485 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: your processes number limit is 47680 Aug 24 16:30:53.822266 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: your memory page size is 4096 bytes Aug 24 16:30:53.822266 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: detected max file descriptor number: 2048 Aug 24 16:30:53.822266 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: lock engine: pthread robust mutexes Aug 24 16:30:53.822266 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: thunder lock: enabled Aug 24 16:30:53.822266 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 16:30:53.822266 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 16:30:53.862089 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: Python main interpreter initialized at 0x55e80d9ba9c0 Aug 24 16:30:53.862089 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: python threads support enabled Aug 24 16:30:53.862089 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: your server socket listen backlog is limited to 100 connections Aug 24 16:30:53.862089 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: your mercy for graceful operations on workers is 90 seconds Aug 24 16:30:53.862418 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 16:30:53.862495 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: *** Operational MODE: preforking *** Aug 24 16:30:53.862744 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: *** uWSGI is running in multiple interpreter mode *** Aug 24 16:30:53.862744 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: spawned uWSGI master process (pid: 112142) Aug 24 16:30:53.862931 dv-cinder-779578-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 16:30:53.863752 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: spawned uWSGI worker 1 (pid: 112143, cores: 1) Aug 24 16:30:53.863864 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: spawned uWSGI worker 2 (pid: 112144, cores: 1) Aug 24 16:30:53.863984 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 16:30:54.531710 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:30:54.559454 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:30:55.616830 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:30:55.616830 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: from cryptography.utils import int_from_bytes Aug 24 16:30:55.617428 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:30:55.617428 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: from cryptography.utils import int_from_bytes Aug 24 16:30:55.625455 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:30:55.625455 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: from cryptography.utils import int_from_bytes Aug 24 16:30:55.625894 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:30:55.625894 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: from cryptography.utils import int_from_bytes Aug 24 16:30:58.100549 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:30:58.101174 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:30:58.101266 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:30:58.101266 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:30:58.101673 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:30:58.101673 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:30:58.101831 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:30:58.101911 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:30:58.102041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:30:58.102259 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.102362 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:30:58.102584 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.102680 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.102902 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.103004 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.103221 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.103317 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.103549 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.104299 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.104754 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.104838 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.104930 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.105015 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.105182 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.105267 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.105435 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.105596 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.105765 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.105857 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.106017 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.106157 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.106329 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.106481 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-5-iscsi {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.106670 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-5-iscsi {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.106808 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.106982 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.107110 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.107288 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.107419 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.107600 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.107732 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.107917 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.108043 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.108245 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.108365 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.108566 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.108660 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.108875 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.109151 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.109387 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.109591 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.109681 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.109895 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.109983 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.110200 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.110296 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.110539 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.110644 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.110846 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.110943 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.111151 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.111239 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.111465 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.111552 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.111765 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.111852 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.112109 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.112212 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.112417 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.112505 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.112807 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-5-iscsi {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.112895 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-5-iscsi {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.113119 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.113205 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.113430 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.113531 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.113739 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.113836 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.114141 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.114316 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.114449 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.114538 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.114756 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.114857 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.115070 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.115172 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.115392 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.115491 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.115693 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.115796 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.116045 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.116156 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.116360 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.116453 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.116674 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.116771 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.116992 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.117089 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.117292 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.117380 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.117599 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.117687 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.117906 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.118040 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.118222 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.118316 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.118524 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.118613 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.118831 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.118918 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.119073 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.119159 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.119462 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.119575 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.119902 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.120052 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.120249 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.120336 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.120577 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.120677 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.120826 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.120914 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.121074 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.121174 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.121393 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.121482 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.121715 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.121801 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.122022 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.122109 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.122329 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.122416 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.122636 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.122722 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.122942 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.123028 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.123243 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.123328 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.123549 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.123643 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.123852 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.124001 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.124183 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.124270 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.124500 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.124600 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.124812 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.124906 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.125132 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.125227 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.125441 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.125564 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.125763 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.125857 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.126156 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.126246 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.126408 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.126520 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.126714 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.126801 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.127054 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.127160 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.127377 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.127478 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.127688 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.127776 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.128045 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.128135 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.128394 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.128483 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.128697 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.128782 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.129000 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.129087 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.129305 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.129393 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.129624 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.129712 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.129955 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.130049 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.130257 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.130356 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.130511 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.130597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.130806 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.130900 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.131108 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.131196 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.131423 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.131509 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.131725 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.131820 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.132055 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.132159 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.132360 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.132445 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.132658 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.132766 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.132966 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.133074 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.133270 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.133371 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.133573 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.133674 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.133874 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.133970 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.134177 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.134263 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.134479 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.134576 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.134784 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.134873 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.135113 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.135202 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.135422 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.135594 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.135747 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.135887 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.136145 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.136301 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.136459 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.136548 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.136769 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.136865 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.137077 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.137216 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.137387 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.137487 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.137701 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.137786 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.138007 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.138099 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.138312 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.138413 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.138631 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.138718 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.138935 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.139023 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.139234 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.139321 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.139551 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.139638 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.139854 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.139939 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.140184 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.140275 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.140504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.140597 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.140802 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.140899 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.141107 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.141196 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.141421 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.141508 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.141727 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.141812 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.142026 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.142123 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.142325 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.142413 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.142625 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.142727 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.142924 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.143019 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.143225 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.143311 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.143520 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.143614 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.143817 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.143904 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.144140 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.144226 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.144453 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.144553 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.144770 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.144865 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.145073 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.145167 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.145376 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.145472 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.145683 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.145804 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.145996 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.146088 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:30:58.146327 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.146437 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.146657 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.146744 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.146994 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.147078 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.147305 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.147393 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.147637 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.147731 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.147981 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.148071 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.148302 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.148391 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.148613 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.148708 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.148924 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.149010 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.149249 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.149336 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.149555 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.149648 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.149864 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.149960 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.150174 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.150310 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.151069 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.151315 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.151495 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.151705 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.152004 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.152157 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.152328 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.152628 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.152785 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.152947 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.153195 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.153351 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.153546 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.153763 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.153919 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.154183 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.154334 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.154479 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.154799 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.154965 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.155144 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.155386 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.155540 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.155766 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.155928 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.156150 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.156412 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.156650 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.156800 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.157013 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.157161 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.157320 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.157625 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.157784 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.157931 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.158169 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.158383 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.158533 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.158755 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.158910 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.159133 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.159320 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.159472 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.159746 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.159910 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.160134 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.160387 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.160863 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.161013 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.161202 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.161376 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.161535 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.161768 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.161923 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.162145 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.162340 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.162496 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.162745 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.162906 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.163051 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.163339 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.163507 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.163653 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.163907 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.164095 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.164259 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.164492 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.164661 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.164857 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.165046 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.165211 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.165481 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.165693 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.165855 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.166841 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.167071 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.167219 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.167219 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.167466 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.167726 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.167873 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.168111 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.168259 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.168474 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.168634 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.168785 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.168979 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.169143 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.169353 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.169550 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.169723 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.169966 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.170117 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.170264 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.170550 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.170703 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.170865 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.171164 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.171316 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.171461 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.171689 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.171845 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.172101 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.172262 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.172421 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.172734 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.172900 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.173060 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.173288 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.173443 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.173654 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.173805 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.173980 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.174297 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.174506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.174654 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.174883 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.175038 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.175181 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.175425 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.175579 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.175758 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.176029 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.176186 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.176380 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.176585 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.176739 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.176971 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.177119 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.177265 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.177562 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.177712 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.177857 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.178129 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.178287 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.178448 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.178677 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.178831 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.179034 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.179229 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.179382 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.179666 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.179829 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.180026 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.180275 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.180446 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.180665 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.180842 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.181012 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.181292 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.181444 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.181602 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.181865 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.182040 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.182270 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.182422 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.182569 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.182879 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.183031 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.183187 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.183420 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.183590 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.183795 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.184003 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.184151 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.184444 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.184599 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.184743 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.185007 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.185162 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.185342 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.185563 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.185718 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.185980 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.186129 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.186310 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.186614 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.186770 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.186947 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.187183 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.187339 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.187530 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.187743 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.187897 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.188161 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.188338 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.188489 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.188767 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.188944 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.189092 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.189374 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.189543 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.189690 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.189933 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.190109 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.190285 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.190513 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.190665 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.190894 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.191057 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.191205 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.191498 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.191648 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.191799 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.192092 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.192269 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.192457 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.192648 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.192800 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.193073 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.193224 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.193382 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.193654 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.193809 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.193965 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.194195 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.194366 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.194531 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.194745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.194892 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.195120 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.195269 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.195429 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.195718 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.195869 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.196043 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.196285 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.196442 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.196613 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.196826 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.196992 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.197193 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.197417 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.197570 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.197836 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.197985 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.198130 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.198432 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.198598 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.198756 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.198977 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.199132 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.199330 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.199523 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.199689 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.199983 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.200154 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.200318 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.200557 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.200707 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.200851 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.201183 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.201351 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.201497 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.201755 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.201920 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.202082 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.202317 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.202473 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.202665 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.202883 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.203036 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.203266 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.203527 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.203675 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.203877 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.204053 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.204200 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.204485 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.204659 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.204818 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.205041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.205194 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.205389 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.205593 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.205744 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.206008 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.206158 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.206303 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.206610 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.206783 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.206929 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.207155 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.207369 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.207516 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.207725 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.207900 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.208281 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.208439 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.208693 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.208855 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.209000 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.209313 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.209466 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.209611 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.209859 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.210015 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.210245 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.210394 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.210560 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.210885 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.211040 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.211199 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.211482 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.211637 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.211795 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.212075 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.212231 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.212403 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.212634 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.212810 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.213510 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.213709 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.213863 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.214109 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.214256 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.214415 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.214699 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.214932 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.215083 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.215283 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.215436 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.215595 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.215827 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.216020 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.216213 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.216415 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.216566 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.216817 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.216966 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.217111 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.217412 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.217565 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.217722 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.217970 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.218125 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.218325 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.218530 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.218682 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.218950 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.219103 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.219276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.219564 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.219719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.219905 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.220142 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.220291 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.220549 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.220699 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.220842 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.221140 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.221308 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.221513 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.221700 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.221852 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.222027 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.222277 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.222431 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.222626 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.222848 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.223002 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.223222 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.223386 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.223532 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.223814 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.223989 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.224219 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.224499 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.224674 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.224840 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.225052 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.225201 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.225399 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.225602 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.225774 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.225990 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.226140 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.226283 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.226580 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.226763 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.226923 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.227146 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.227301 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.227446 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.227680 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.227849 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.228142 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.228293 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.228438 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.229285 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.229459 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.229814 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.229978 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.230222 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.230451 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.230606 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.230850 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.231015 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.231161 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.231454 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.231605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.231763 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.232033 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.232206 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.232385 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.232584 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.232737 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.233002 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.233247 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.233398 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.233602 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.233752 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.233915 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.234174 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.234342 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.234489 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.234730 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.234896 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.235045 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.235286 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.235464 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.235609 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.235827 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.236012 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.236235 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.236403 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.236548 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.236844 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.237009 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.237168 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.237413 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.237679 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.237828 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.237968 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.238114 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.238334 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.238483 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.238641 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.238963 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.239133 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.239278 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.239536 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.239692 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.239863 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.240110 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.240266 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.240483 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.240658 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.240822 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.241082 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.241251 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.241412 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.241692 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.241846 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.242010 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.242242 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.242398 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.242581 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.242801 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.242953 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.243201 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.243351 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.243507 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.243816 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.244025 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.244172 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.244482 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.244643 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.244791 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.245082 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.245234 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.245392 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.245627 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.245782 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.245970 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.246177 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.246333 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.246572 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.246723 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.246869 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.247174 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.247325 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.247470 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.247725 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.247879 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.248073 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.248310 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.248466 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.248670 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.248864 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.249015 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.249278 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.249429 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.249593 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.249873 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.250026 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.250169 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.250407 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.250575 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.250754 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.250975 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.251215 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.251468 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.251622 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.251822 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.252097 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.252400 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.252566 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.252725 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.252969 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.253125 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.253298 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.253527 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.253684 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.253896 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.254075 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.254309 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.254596 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.254769 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.254915 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.255147 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.255372 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.255521 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.255736 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.255890 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.256174 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.256317 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.256462 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.256684 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.256894 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.257061 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.257267 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.257440 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.257592 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.257873 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.258025 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.258184 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.258450 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.258615 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.258879 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.259032 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.259179 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.259467 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.259634 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.260419 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.260572 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.260718 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.261023 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.261193 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.261342 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.261567 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.261721 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.261927 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.262132 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.262283 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.262529 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.262683 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.262828 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.263111 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.263281 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.263428 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.263644 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.263798 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.264065 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.264235 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.264395 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.264697 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.264850 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.265007 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.265231 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.265454 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.265711 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.265865 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.266011 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.266285 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.266452 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.266612 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.266847 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.267012 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.267235 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.267384 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.267528 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.267832 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.268012 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.268159 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.268396 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.268551 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.268753 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.268930 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.269077 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.269355 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.269507 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.269665 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.269955 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.270121 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.270266 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.270515 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.270670 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.270846 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.271101 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.271249 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.271456 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.271678 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.271842 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.272100 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.272277 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.272426 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.272711 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.272864 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.273009 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.273281 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.273450 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.273596 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.273816 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.273969 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.274184 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.274348 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.274507 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.274812 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.274965 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.275108 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.275343 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.275782 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.275984 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.276117 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.276326 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.276573 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.276715 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.277020 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.277173 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.277319 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.277573 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.277738 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.277948 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.278111 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.278268 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.278543 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.278757 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.278907 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.279139 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.279300 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.279447 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.279681 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.279836 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.280049 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.280262 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.280414 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.280642 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.280792 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.280957 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.281249 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.281422 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.281570 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.281810 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.281967 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.282171 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.282427 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.282600 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.282747 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.282899 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.283047 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.283344 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.283510 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.283657 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.283896 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.284095 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.284280 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.284472 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.284653 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.284909 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.285069 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.285215 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.285763 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.285931 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.286097 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.286308 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.286461 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.286695 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.286842 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.287086 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.287304 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.287457 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.287614 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.287866 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.288058 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.288244 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.288444 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.288765 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.288917 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.289075 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.289395 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.289561 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.289707 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.289944 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.290099 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.290296 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.290483 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.290656 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.290902 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.291052 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.291736 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.292066 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.292282 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.292545 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.292696 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.292878 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.293143 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.293309 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.293514 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.293691 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.293843 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.294152 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.294303 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.294449 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.294731 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.294887 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.295047 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.295269 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.295436 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.295704 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.295855 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.296022 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.296307 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.296463 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.296637 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.296850 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.297005 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.297251 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.297413 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.297559 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.297860 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.298013 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.298164 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.298396 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.298550 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.298757 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.298983 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.299141 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.299363 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.299529 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.299688 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.299975 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.300130 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.300334 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.300525 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.300693 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.300948 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.301097 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.301255 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.301561 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.301766 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.302060 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.302214 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.302409 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.302627 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.302775 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.303048 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.303199 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.303344 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.303643 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.303799 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.303992 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.304214 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.304375 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.304583 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.304813 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.304966 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.305189 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.305352 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.305499 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.305797 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.305949 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.306095 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.306359 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.306524 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.306779 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.307479 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.307634 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.307988 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.308167 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.308461 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.308614 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.308772 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.309013 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.309168 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.309397 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.309550 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.309694 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.310002 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.310118 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.310340 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.310603 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.310712 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.310922 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.311069 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.311247 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.311534 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.311692 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.311843 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.312138 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.312316 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.312477 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.312701 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.312852 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.313029 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.313251 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.313420 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.313625 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.313824 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.313980 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.314239 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.314403 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.314551 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.314829 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.315741 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.315894 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.316103 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.316252 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.316252 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.316535 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.316682 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.316682 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.316953 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.317098 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.317098 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.317380 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.317526 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.317526 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.317809 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.317954 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.318099 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.318256 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.318411 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.318623 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.318787 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.318932 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.319212 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.319389 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.319537 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.319764 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.319920 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.320172 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.320341 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.320488 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.320788 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.320942 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.321088 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.321336 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.321561 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.321710 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.321899 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.322236 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.322429 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.322746 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.322925 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.323074 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.323403 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.323559 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.323733 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.324006 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.324210 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.324371 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.324514 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.324660 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.324956 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.325125 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.325272 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.325524 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.325679 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.325824 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.326062 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.326292 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.326441 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.326608 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.326760 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.327013 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.327294 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.327463 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.327610 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.327839 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.328023 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.328215 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.328422 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.328576 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.328814 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.328964 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.329210 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.329446 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.329614 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.329853 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.330002 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.330148 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.330460 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.330616 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.330874 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.331031 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.331188 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.331359 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.331563 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.331718 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.332013 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.332283 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.332463 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.332684 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.332861 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.333021 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.333204 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.333376 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.333531 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.333858 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.334014 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.334214 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.334406 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.334573 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.334838 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.334990 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.335134 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.335421 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.335578 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.335752 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.336016 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.336171 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.336407 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.336554 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.336720 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.337001 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.337152 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.337330 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.337580 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.337735 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.337993 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.338238 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.338384 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.338613 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.338779 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.338928 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.339199 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.339426 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.339588 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.339802 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.340088 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.340240 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.340415 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.340574 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.340721 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.341003 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.341159 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.341316 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.341589 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.341740 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.341900 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.342178 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.342332 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.342477 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.342719 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.342875 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.343048 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.343286 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.343540 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.343690 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.343869 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.344057 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.344234 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.344477 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.344633 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.344819 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.345024 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.345189 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.345406 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.345568 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.345725 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.346018 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.346170 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.346345 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.346606 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.346762 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.346959 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.347182 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.347347 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.347575 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.347739 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.347885 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.348214 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.348385 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.348543 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.348774 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.348942 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.349118 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.349346 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.349513 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.349742 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.349912 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.350069 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.350352 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.350504 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.350660 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.350938 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.351107 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.351254 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.351555 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.351719 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.351867 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.352184 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.352367 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.352517 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.352734 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.352888 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.353123 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.353288 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.353435 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.354252 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.354409 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.354660 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.354825 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.354984 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.355275 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.355442 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.355590 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.355821 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.356008 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.356183 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.356396 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.356609 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.356797 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.356944 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.357104 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.357412 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.357566 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.357725 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.357960 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.358127 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.358345 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.358496 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.358641 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.358964 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.359117 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.359271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.359512 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.359667 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.359915 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.360097 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.360260 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.360546 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.360715 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.360895 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.361117 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.361290 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.361500 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.361672 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.361831 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:30:58.362158 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.362588 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.363017 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.363442 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.363864 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.364337 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.364755 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.365168 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.365578 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.366005 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.366466 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.366904 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.367331 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.367773 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.368249 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.368666 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.369117 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.370134 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.370654 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.371080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.371516 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.371989 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.372393 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.372809 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.373232 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.373643 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.374081 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.374505 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.374913 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.375322 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.375733 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.376200 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.376611 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.377072 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.377494 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.377908 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.378318 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.378731 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.379183 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.379598 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.380069 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.380485 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.380915 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.381339 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.381773 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.382204 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.382628 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.383051 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.383474 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.383896 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.384352 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.384778 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.385502 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.385848 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.386549 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.387039 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.387494 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.387915 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.388366 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.388800 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.389233 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.389652 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.390075 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.390507 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.390889 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.391275 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.391658 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.392090 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.392512 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.392900 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.393285 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.393679 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.394063 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.394498 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.394881 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.395267 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.395673 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.396091 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.396491 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.396883 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.397302 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.397701 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.398080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.398468 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.398859 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.399249 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.399627 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.400070 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.400574 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.401056 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.401450 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.401837 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.402231 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.402832 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.403230 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.403659 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.404083 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.404474 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.404861 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.405324 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.405783 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.406235 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.406676 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.407121 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.407565 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.408045 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.408473 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.408905 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.409318 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.409802 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.410220 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.411147 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.411602 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.412071 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.412508 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.412942 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.413417 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.413823 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.414234 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.414623 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.415004 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.415402 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.415775 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.416738 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.417129 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.417540 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.417930 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.418315 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.418706 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.419083 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.419496 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.419883 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.420295 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.420680 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.421087 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.421474 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.421866 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.422261 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.422634 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.423026 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.423397 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.423848 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.424262 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.424711 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.425135 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.425563 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.425982 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.426428 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.426842 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.427316 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.427786 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.428264 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.428693 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.429124 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.429549 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.430008 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.430430 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.431127 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.431566 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.432605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.433070 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.433502 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.434008 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.434430 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.434851 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.435288 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.435706 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.436183 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.436600 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.437017 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.437442 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.437860 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.438278 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.438694 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.439121 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.439540 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.439988 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.440344 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.440674 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.441007 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.441434 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.441903 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.442333 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.442758 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.443176 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.443616 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.444001 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.444397 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.444804 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.445136 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.445472 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.445821 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.446152 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.446473 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.446925 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.447252 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.448158 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.448608 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.449042 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.449473 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.449907 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.450356 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.450783 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.451200 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.451649 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.452174 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.452609 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.453041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.453463 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.453880 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.454380 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.454858 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.455212 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.455546 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.455988 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.456409 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.456830 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.457245 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.457661 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.458072 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.458481 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.458899 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.459308 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.459721 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.460175 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.460587 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.460995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.461418 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.461837 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.462248 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.462655 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.463151 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.464077 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.464578 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.465108 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.465573 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.466018 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.466457 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.466889 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.467317 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.467738 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.468213 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.468644 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.469067 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.469492 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.469935 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.470353 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.470772 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.471192 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.471622 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.472087 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.472504 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.472938 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.473371 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.473785 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.474220 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.474710 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.475190 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.475548 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.475879 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.476286 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.476618 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.476994 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.477323 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.477652 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.477978 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.478306 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.479212 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.480177 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.480177 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.480490 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.480723 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.481062 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.481385 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.481731 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.482071 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.482437 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.482764 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.483125 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.483464 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.483790 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.484141 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.484460 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:30:58.484713 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112143) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:30:58.513885 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO dbcounter [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Registered counter for database nova_api Aug 24 16:30:58.533915 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_db.sqlalchemy.engines [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:30:58.540725 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writer thread running {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:30:58.599320 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.context [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),be07c2cf-28a6-420b-a09a-b6459fa4f88c(cell1) {{(pid=112144) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:30:58.603310 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:58.603977 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:58.605987 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:58.608958 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:58.609436 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:58.612733 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:58.614850 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO dbcounter [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Registered counter for database nova_cell0 Aug 24 16:30:58.621636 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO dbcounter [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Registered counter for database nova_cell1 Aug 24 16:30:58.628978 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_db.sqlalchemy.engines [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:30:58.631278 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_db.sqlalchemy.engines [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:30:58.638988 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writer thread running {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:30:58.640456 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writer thread running {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:30:58.643505 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO dbcounter [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Registered counter for database nova_api Aug 24 16:30:58.663581 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG oslo_db.sqlalchemy.engines [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:30:58.670612 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writer thread running {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:30:58.726947 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.context [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),be07c2cf-28a6-420b-a09a-b6459fa4f88c(cell1) {{(pid=112143) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:30:58.730929 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG oslo_concurrency.lockutils [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:58.731418 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG oslo_concurrency.lockutils [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:58.733055 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG oslo_concurrency.lockutils [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:58.733801 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG oslo_concurrency.lockutils [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:30:58.734265 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG oslo_concurrency.lockutils [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:30:58.736300 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG oslo_concurrency.lockutils [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112143) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:30:58.738283 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO dbcounter [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Registered counter for database nova_cell0 Aug 24 16:30:58.743661 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO dbcounter [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Registered counter for database nova_cell1 Aug 24 16:30:58.753397 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG oslo_db.sqlalchemy.engines [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:30:58.755268 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG oslo_db.sqlalchemy.engines [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:30:58.763468 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writer thread running {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:30:58.763806 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writer thread running {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:30:58.786645 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO dbcounter [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Registered counter for database nova_cell0 Aug 24 16:30:58.793259 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_db.sqlalchemy.engines [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:30:58.797517 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writer thread running {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:30:58.914630 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO dbcounter [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Registered counter for database nova_cell0 Aug 24 16:30:58.923790 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG oslo_db.sqlalchemy.engines [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112143) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:30:58.928211 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writer thread running {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:30:59.135461 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: WARNING keystonemiddleware.auth_token [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:30:59.142781 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: WARNING keystonemiddleware.auth_token [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:30:59.243605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: WARNING keystonemiddleware.auth_token [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:30:59.251337 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: WARNING keystonemiddleware.auth_token [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:30:59.484620 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: WARNING keystonemiddleware.auth_token [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:30:59.490811 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: WARNING keystonemiddleware.auth_token [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:30:59.496772 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e80d9ba9c0 pid: 112144 (default app) Aug 24 16:30:59.499031 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:30:59.500260 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001905 Aug 24 16:30:59.500678 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Aug 24 16:30:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:30:59.599818 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: WARNING keystonemiddleware.auth_token [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:30:59.606821 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: WARNING keystonemiddleware.auth_token [None req-676f2902-bd41-4ff8-9a2a-15dadf2a043b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:30:59.612156 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e80d9ba9c0 pid: 112143 (default app) Aug 24 16:32:18.527348 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:18.528582 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Aug 24 16:32:18.529084 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:18.547134 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writing DB stats nova_api:SELECT=3 {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:18.548518 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writing DB stats nova_cell0:SELECT=3 {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:18.549359 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writing DB stats nova_cell1:SELECT=3 {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:18.550266 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writing DB stats nova_cell0:SELECT=3 {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:19.451559 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-a75d5503-e4fb-4ad6-a666-c96eea185226 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:19.485334 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-a75d5503-e4fb-4ad6-a666-c96eea185226 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.949011 Aug 24 16:32:19.486304 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 24 16:32:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:32:21.873916 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:21.874581 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-5d4f7045-56fb-4ad2-99a4-aa3c91527c02 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 24 16:32:21.876255 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:22.305042 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-0a286740-0e9f-4885-86a8-97ad8fafcd23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "ram": 256, "disk": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:22.329661 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:32:22.329661 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: warnings.warn(msg) Aug 24 16:32:22.362988 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-0a286740-0e9f-4885-86a8-97ad8fafcd23 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.481965 Aug 24 16:32:22.368143 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 16:32:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:32:22.378536 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writing DB stats nova_api:SELECT=3 {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:22.379358 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writing DB stats nova_cell0:SELECT=3 {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:22.380261 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writing DB stats nova_cell1:SELECT=3 {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:22.381289 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:22.606573 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-d6bb0e83-4d75-49da-b1d0-f68b8ef5a42a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:22.610934 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:32:22.610934 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: warnings.warn(msg) Aug 24 16:32:22.676271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-d6bb0e83-4d75-49da-b1d0-f68b8ef5a42a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.303392 Aug 24 16:32:22.676864 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 24 16:32:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:32:25.039788 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-0a286740-0e9f-4885-86a8-97ad8fafcd23 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:25.040924 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-0a286740-0e9f-4885-86a8-97ad8fafcd23 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001688 Aug 24 16:32:25.041341 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:25.705248 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-1c4de220-cc45-4133-b485-1fa4e6aea812 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:25.726356 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:32:25.726356 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: warnings.warn(msg) Aug 24 16:32:25.752000 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-1c4de220-cc45-4133-b485-1fa4e6aea812 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.704347 Aug 24 16:32:25.759799 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 16:32:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:32:25.766419 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-40a37b9a-2bca-43eb-94d7-9906d56e196c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:25.769479 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:32:25.769479 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: warnings.warn(msg) Aug 24 16:32:25.807634 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-40a37b9a-2bca-43eb-94d7-9906d56e196c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044847 Aug 24 16:32:25.816573 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 24 16:32:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:32:28.248116 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-1c4de220-cc45-4133-b485-1fa4e6aea812 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:28.249125 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-1c4de220-cc45-4133-b485-1fa4e6aea812 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 24 16:32:28.249521 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:28.651277 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-7c726d1c-34bf-4ba4-87f2-1e162d06c082 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G"}} {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:28.672785 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-7c726d1c-34bf-4ba4-87f2-1e162d06c082 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.417000 Aug 24 16:32:28.673343 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 16:32:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:32:28.685800 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-c69bb980-ee13-4ef0-a943-4423ee2a522b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:28.709321 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-c69bb980-ee13-4ef0-a943-4423ee2a522b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027143 Aug 24 16:32:28.709938 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 24 16:32:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:32:31.099306 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-7c726d1c-34bf-4ba4-87f2-1e162d06c082 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:31.101381 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-7c726d1c-34bf-4ba4-87f2-1e162d06c082 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 24 16:32:31.101782 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:31.576667 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-f54b57db-7a9b-4d9a-bf31-9506840437a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:31.596876 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-f54b57db-7a9b-4d9a-bf31-9506840437a2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489116 Aug 24 16:32:31.597452 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 16:32:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:32:31.610398 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-3a007112-cc2b-478b-bf5f-6691297773b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:31.636339 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-3a007112-cc2b-478b-bf5f-6691297773b1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029637 Aug 24 16:32:31.637075 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 24 16:32:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:32:34.085710 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-f54b57db-7a9b-4d9a-bf31-9506840437a2 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:34.086722 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-f54b57db-7a9b-4d9a-bf31-9506840437a2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002542 Aug 24 16:32:34.087117 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:34.536534 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-f4d129f2-77dc-4575-8d6a-24e3ffab3da9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:34.556473 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-f4d129f2-77dc-4575-8d6a-24e3ffab3da9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.463277 Aug 24 16:32:34.560027 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 16:32:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:32:34.569794 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-63fbae59-0cf0-4c34-aab6-3402717c1b1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:34.595102 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-63fbae59-0cf0-4c34-aab6-3402717c1b1b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029367 Aug 24 16:32:34.595695 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 24 16:32:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:32:37.351902 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-f4d129f2-77dc-4575-8d6a-24e3ffab3da9 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:37.353021 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-f4d129f2-77dc-4575-8d6a-24e3ffab3da9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Aug 24 16:32:37.353454 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:37.784623 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-d8ce96e2-1554-405d-a34b-3cd9d922c8b9 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:37.809251 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-d8ce96e2-1554-405d-a34b-3cd9d922c8b9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449388 Aug 24 16:32:37.809789 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 24 16:32:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:32:40.262124 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-f4d129f2-77dc-4575-8d6a-24e3ffab3da9 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:40.263068 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-f4d129f2-77dc-4575-8d6a-24e3ffab3da9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 24 16:32:40.263471 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:40.719964 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-f8f7cc1b-e07a-4850-8530-d2bd02dfbadc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "1"}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:40.744448 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-f8f7cc1b-e07a-4850-8530-d2bd02dfbadc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.473321 Aug 24 16:32:40.745169 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 16:32:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:32:40.759303 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-1b3fc256-747a-47d7-8386-1075803c30b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:40.784667 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-1b3fc256-747a-47d7-8386-1075803c30b9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029331 Aug 24 16:32:40.785273 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 24 16:32:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:32:43.153634 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-f8f7cc1b-e07a-4850-8530-d2bd02dfbadc admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:43.154652 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-f8f7cc1b-e07a-4850-8530-d2bd02dfbadc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 24 16:32:43.155058 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:43.533303 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-96b156b5-7e5e-41fc-ad02-93927d27cf41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "swap": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:43.553686 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-96b156b5-7e5e-41fc-ad02-93927d27cf41 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.392018 Aug 24 16:32:43.554132 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 16:32:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:32:43.566125 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-908ad3e5-774c-4cfe-ac16-71e21febbb80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:43.590649 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-908ad3e5-774c-4cfe-ac16-71e21febbb80 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028116 Aug 24 16:32:43.591226 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 24 16:32:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:32:45.999786 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-96b156b5-7e5e-41fc-ad02-93927d27cf41 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:46.000783 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-96b156b5-7e5e-41fc-ad02-93927d27cf41 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 24 16:32:46.004236 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:45 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:46.462864 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-da312f82-7dd3-483a-9fc8-806f5db649c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:46.483622 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-da312f82-7dd3-483a-9fc8-806f5db649c9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.475828 Aug 24 16:32:46.484837 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 16:32:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:32:46.497044 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-53bdb43f-aac6-4ba2-a154-5a2a6c297dd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:46.524011 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-53bdb43f-aac6-4ba2-a154-5a2a6c297dd8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030680 Aug 24 16:32:46.531939 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 24 16:32:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:32:48.974760 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-da312f82-7dd3-483a-9fc8-806f5db649c9 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:48.976489 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-da312f82-7dd3-483a-9fc8-806f5db649c9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Aug 24 16:32:48.976891 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:49.426423 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-611fbdeb-9c2f-4d47-a4fa-55ab55c786f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "disk": 80}} {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:49.432143 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:49.452749 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-611fbdeb-9c2f-4d47-a4fa-55ab55c786f8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469849 Aug 24 16:32:49.453630 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 16:32:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:32:49.466135 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-af42f8cd-d5d2-4048-9a9a-289e5481f243 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:49.494104 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-af42f8cd-d5d2-4048-9a9a-289e5481f243 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031470 Aug 24 16:32:49.494971 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 24 16:32:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:32:51.910605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-611fbdeb-9c2f-4d47-a4fa-55ab55c786f8 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:32:51.911777 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-611fbdeb-9c2f-4d47-a4fa-55ab55c786f8 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 24 16:32:51.912374 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:32:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:32:52.350282 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-d6681b7a-6b9d-4113-94b8-5e00c1accda0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:52.369644 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-d6681b7a-6b9d-4113-94b8-5e00c1accda0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.450593 Aug 24 16:32:52.370205 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 16:32:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:32:52.383439 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-b8c1e156-1daa-46c6-81e3-88c41864a146 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:32:52.410243 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-b8c1e156-1daa-46c6-81e3-88c41864a146 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031544 Aug 24 16:32:52.410848 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 24 16:32:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:33:10.724059 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-d6681b7a-6b9d-4113-94b8-5e00c1accda0 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:10.725084 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-d6681b7a-6b9d-4113-94b8-5e00c1accda0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 24 16:33:10.725494 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:33:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:33:10.735964 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:11.121962 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-cf080561-dbc0-4fcb-89a6-22138b4a1134 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:11.140253 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-cf080561-dbc0-4fcb-89a6-22138b4a1134 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.408755 Aug 24 16:33:11.140785 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 24 16:33:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:33:12.204346 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-d6681b7a-6b9d-4113-94b8-5e00c1accda0 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:12.205357 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-d6681b7a-6b9d-4113-94b8-5e00c1accda0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 16:33:12.205755 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:33:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:33:12.738738 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-f3512554-a255-4f16-aa69-9d477146599c admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:12.744419 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.wsgi [None req-f3512554-a255-4f16-aa69-9d477146599c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-f3512554-a255-4f16-aa69-9d477146599c admin admin] Request method failure captured: Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Accept: application/json Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Accept-Encoding: gzip, deflate Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Connection: keep-alive Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Content-Length: 0 Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Host: 10.222.0.52 Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Openstack-Api-Version: compute 2.90 Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Openstack-System-Scope: None Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: User-Agent: python-novaclient Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Auth-Token: gAAAAABjBlLIx0GgPvsGUJJqWHmYq3x8t__Lu_hwoohMeCkZjQ1w-KyUSxdMx9a43z71GWAk7671V3v1LzOfh6OSUbERtUB8IcAovAw5wFCetrJ72DrbS5OT-KfjRwig417ccHjKEdc2yGZHDhYOV5-9zm5zqzvnNgl6zUNqRr1IoUKCV-i-UQ4 Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Domain-Id: None Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Domain-Name: None Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Identity-Status: Confirmed Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Is-Admin-Project: True Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Domain-Id: default Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Domain-Name: Default Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Name: admin Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Role: reader,member,admin Aug 24 16:33:12.747605 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Roles: reader,member,admin Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ad742c0425e4471ab69af90dda50deea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Tenant: admin Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Tenant-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Tenant-Name: admin Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User: admin Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Domain-Id: default Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Domain-Name: Default Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Id: bcc81a9e50c0416682e495a7f72fd265 Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Name: admin Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: method: > Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: exception: Flavor 42 could not be found. Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: action_args: {'id': '42'} Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:33:12.749287 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:12.750388 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:12.751857 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-f3512554-a255-4f16-aa69-9d477146599c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:33:12.753126 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-f3512554-a255-4f16-aa69-9d477146599c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401188 Aug 24 16:33:12.753126 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 24 16:33:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:12.758685 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-f1f77f91-0fbf-4c30-acb1-ecce588db8b3 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:12.762880 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:12.782776 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-f1f77f91-0fbf-4c30-acb1-ecce588db8b3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027641 Aug 24 16:33:12.783338 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 16:33:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:33:12.793594 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-61e9b121-a376-49fa-87fb-d364050abf16 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:12.818316 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-61e9b121-a376-49fa-87fb-d364050abf16 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028204 Aug 24 16:33:12.818859 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 16:33:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:33:12.828949 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-52cf3a6c-fa41-42ca-a0e7-e479ac586433 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:12.835921 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.wsgi [None req-52cf3a6c-fa41-42ca-a0e7-e479ac586433 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-52cf3a6c-fa41-42ca-a0e7-e479ac586433 admin admin] Request method failure captured: Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Accept: application/json Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Accept-Encoding: gzip, deflate Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Connection: keep-alive Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Content-Length: 0 Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Host: 10.222.0.52 Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Openstack-Api-Version: compute 2.90 Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Openstack-System-Scope: None Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: User-Agent: python-novaclient Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Auth-Token: gAAAAABjBlLIx0GgPvsGUJJqWHmYq3x8t__Lu_hwoohMeCkZjQ1w-KyUSxdMx9a43z71GWAk7671V3v1LzOfh6OSUbERtUB8IcAovAw5wFCetrJ72DrbS5OT-KfjRwig417ccHjKEdc2yGZHDhYOV5-9zm5zqzvnNgl6zUNqRr1IoUKCV-i-UQ4 Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Domain-Id: None Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Domain-Name: None Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Identity-Status: Confirmed Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Is-Admin-Project: True Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Domain-Id: default Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Domain-Name: Default Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Name: admin Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Role: reader,member,admin Aug 24 16:33:12.839218 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Roles: reader,member,admin Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ad742c0425e4471ab69af90dda50deea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Tenant: admin Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Tenant-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Tenant-Name: admin Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User: admin Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Domain-Id: default Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Domain-Name: Default Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Id: bcc81a9e50c0416682e495a7f72fd265 Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Name: admin Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: method: > Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: exception: Flavor 42 could not be found. Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: action_args: {'id': '42'} Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:33:12.840603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:12.841504 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:12.842889 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-52cf3a6c-fa41-42ca-a0e7-e479ac586433 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112144) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:33:12.844075 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-52cf3a6c-fa41-42ca-a0e7-e479ac586433 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015980 Aug 24 16:33:12.844075 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 24 16:33:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:13.808431 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-61e9b121-a376-49fa-87fb-d364050abf16 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:13.809452 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-61e9b121-a376-49fa-87fb-d364050abf16 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 24 16:33:13.809851 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:33:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:33:14.354792 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-ab1b11cb-5100-4707-8f93-cf9404954923 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:14.360092 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.wsgi [None req-ab1b11cb-5100-4707-8f93-cf9404954923 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-ab1b11cb-5100-4707-8f93-cf9404954923 admin admin] Request method failure captured: Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Accept: application/json Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Accept-Encoding: gzip, deflate Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Connection: keep-alive Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Content-Length: 0 Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Host: 10.222.0.52 Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Openstack-Api-Version: compute 2.90 Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Openstack-System-Scope: None Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: User-Agent: python-novaclient Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Auth-Token: gAAAAABjBlLJ1H8-vIv8Jt4RTmUrz6i2pal_nAO-xEmn0oEcQBVFy-r-YYsQdN5ZPL0KfFyk0UVymsxwJ39k5u_7uxtpqC8MI2txWuvGjbncALq_jpmCP4drpvt37Sr4SAeIBLzHiSjWCnb78iZ-_b47eCCBQ5dvM76153Cu2QBYoqtAARk5AtA Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Domain-Id: None Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Domain-Name: None Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Identity-Status: Confirmed Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Is-Admin-Project: True Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Domain-Id: default Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Domain-Name: Default Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Name: admin Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Role: reader,member,admin Aug 24 16:33:14.361597 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Roles: reader,member,admin Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ad742c0425e4471ab69af90dda50deea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Tenant: admin Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Tenant-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Tenant-Name: admin Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User: admin Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Domain-Id: default Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Domain-Name: Default Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Id: bcc81a9e50c0416682e495a7f72fd265 Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Name: admin Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: method: > Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: exception: Flavor 84 could not be found. Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: action_args: {'id': '84'} Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:33:14.363080 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:14.365079 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:14.366391 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-ab1b11cb-5100-4707-8f93-cf9404954923 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112144) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:33:14.367588 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-ab1b11cb-5100-4707-8f93-cf9404954923 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.411188 Aug 24 16:33:14.367588 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 24 16:33:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:14.373290 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-5f083b21-de61-4160-a330-bb7682b3d1e1 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:14.388198 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-5f083b21-de61-4160-a330-bb7682b3d1e1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018422 Aug 24 16:33:14.388732 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 16:33:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:33:14.398012 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-e52e36fe-437a-4b3f-bdc2-6b4ee2bb552b admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:14.413632 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-e52e36fe-437a-4b3f-bdc2-6b4ee2bb552b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019142 Aug 24 16:33:14.414162 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 16:33:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:33:14.423630 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-c13f7b3d-5f9f-43e0-93e0-9907eed16087 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:14.429003 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.wsgi [None req-c13f7b3d-5f9f-43e0-93e0-9907eed16087 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-c13f7b3d-5f9f-43e0-93e0-9907eed16087 admin admin] Request method failure captured: Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Accept: application/json Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Accept-Encoding: gzip, deflate Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Connection: keep-alive Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Content-Length: 0 Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Host: 10.222.0.52 Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Openstack-Api-Version: compute 2.90 Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Openstack-System-Scope: None Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: User-Agent: python-novaclient Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Auth-Token: gAAAAABjBlLJ1H8-vIv8Jt4RTmUrz6i2pal_nAO-xEmn0oEcQBVFy-r-YYsQdN5ZPL0KfFyk0UVymsxwJ39k5u_7uxtpqC8MI2txWuvGjbncALq_jpmCP4drpvt37Sr4SAeIBLzHiSjWCnb78iZ-_b47eCCBQ5dvM76153Cu2QBYoqtAARk5AtA Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Domain-Id: None Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Domain-Name: None Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Identity-Status: Confirmed Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Is-Admin-Project: True Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Domain-Id: default Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Domain-Name: Default Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Name: admin Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Role: reader,member,admin Aug 24 16:33:14.430506 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Roles: reader,member,admin Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ad742c0425e4471ab69af90dda50deea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Tenant: admin Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Tenant-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Tenant-Name: admin Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User: admin Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Domain-Id: default Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Domain-Name: Default Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Id: bcc81a9e50c0416682e495a7f72fd265 Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Name: admin Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: method: > Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: exception: Flavor 84 could not be found. Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: action_args: {'id': '84'} Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:33:14.431995 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:14.432854 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:14.434080 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-c13f7b3d-5f9f-43e0-93e0-9907eed16087 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:33:14.435170 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-c13f7b3d-5f9f-43e0-93e0-9907eed16087 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011937 Aug 24 16:33:14.435170 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 24 16:33:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:15.422451 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-e52e36fe-437a-4b3f-bdc2-6b4ee2bb552b admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:15.423460 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-e52e36fe-437a-4b3f-bdc2-6b4ee2bb552b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 24 16:33:15.423861 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:33:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:33:15.947885 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-ff4c7950-ec9b-4f0d-af5e-9b9c4adcc7f0 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:15.953647 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.wsgi [None req-ff4c7950-ec9b-4f0d-af5e-9b9c4adcc7f0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-ff4c7950-ec9b-4f0d-af5e-9b9c4adcc7f0 admin admin] Request method failure captured: Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Accept: application/json Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Accept-Encoding: gzip, deflate Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Connection: keep-alive Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Content-Length: 0 Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Host: 10.222.0.52 Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Openstack-Api-Version: compute 2.90 Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Openstack-System-Scope: None Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: User-Agent: python-novaclient Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Auth-Token: gAAAAABjBlLLmtzdEPo0XkTMaSdZydxifjOWB2FiKHtDFrgxBCKMbAcGAVyLyFQ5s5g-loc-Y3nzXUDRk6BhlZee4qbtGBN9NmqaWbaKeWNB6chDKAAsU2f_tbk3o7GbZT8siaeBmhyYaHw-T4jGrDRujPJL-car2bUNl1mXtC1VsIQ_gHy275o Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Domain-Id: None Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Domain-Name: None Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Identity-Status: Confirmed Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Is-Admin-Project: True Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Domain-Id: default Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Domain-Name: Default Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Project-Name: admin Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Role: reader,member,admin Aug 24 16:33:15.955137 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Roles: reader,member,admin Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ad742c0425e4471ab69af90dda50deea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Tenant: admin Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Tenant-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-Tenant-Name: admin Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User: admin Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Domain-Id: default Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Domain-Name: Default Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Id: bcc81a9e50c0416682e495a7f72fd265 Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: X-User-Name: admin Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: method: > Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: exception: Flavor 451 could not be found. Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: action_args: {'id': '451'} Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:33:15.956745 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:15.957705 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: ERROR nova.api.openstack.wsgi Aug 24 16:33:15.959041 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-ff4c7950-ec9b-4f0d-af5e-9b9c4adcc7f0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112143) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:33:15.960397 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-ff4c7950-ec9b-4f0d-af5e-9b9c4adcc7f0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.393821 Aug 24 16:33:15.960397 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 16:33:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:15.966243 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-4dd03b39-e2ca-41a4-b878-790afa851310 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:15.981464 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-4dd03b39-e2ca-41a4-b878-790afa851310 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018737 Aug 24 16:33:15.981997 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 16:33:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:33:15.992020 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:16.006966 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019156 Aug 24 16:33:16.007503 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 16:33:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:33:16.016806 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-0562f23e-8766-4716-b9ec-8f1bd85a3d54 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:16.022215 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.wsgi [None req-0562f23e-8766-4716-b9ec-8f1bd85a3d54 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-0562f23e-8766-4716-b9ec-8f1bd85a3d54 admin admin] Request method failure captured: Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Accept: application/json Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Accept-Encoding: gzip, deflate Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Connection: keep-alive Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Content-Length: 0 Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Host: 10.222.0.52 Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Openstack-Api-Version: compute 2.90 Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Openstack-System-Scope: None Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: User-Agent: python-novaclient Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Auth-Token: gAAAAABjBlLLmtzdEPo0XkTMaSdZydxifjOWB2FiKHtDFrgxBCKMbAcGAVyLyFQ5s5g-loc-Y3nzXUDRk6BhlZee4qbtGBN9NmqaWbaKeWNB6chDKAAsU2f_tbk3o7GbZT8siaeBmhyYaHw-T4jGrDRujPJL-car2bUNl1mXtC1VsIQ_gHy275o Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Domain-Id: None Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Domain-Name: None Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Identity-Status: Confirmed Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Is-Admin-Project: True Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Domain-Id: default Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Domain-Name: Default Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Project-Name: admin Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Role: reader,member,admin Aug 24 16:33:16.023719 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Roles: reader,member,admin Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ad742c0425e4471ab69af90dda50deea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ad742c0425e4471ab69af90dda50deea", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Tenant: admin Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Tenant-Id: ad742c0425e4471ab69af90dda50deea Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-Tenant-Name: admin Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User: admin Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Domain-Id: default Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Domain-Name: Default Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Id: bcc81a9e50c0416682e495a7f72fd265 Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: X-User-Name: admin Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: method: > Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: exception: Flavor 451 could not be found. Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: action_args: {'id': '451'} Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:33:16.025276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:16.026271 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: ERROR nova.api.openstack.wsgi Aug 24 16:33:16.027556 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-0562f23e-8766-4716-b9ec-8f1bd85a3d54 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112144) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:33:16.028622 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-0562f23e-8766-4716-b9ec-8f1bd85a3d54 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011839 Aug 24 16:33:16.028622 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 16:33:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 16:33:16.997145 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:16.998159 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 24 16:33:16.998576 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:33:17.527918 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-39ec81c8-4036-4d22-b9d8-695761306eda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:33:17.547344 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-39ec81c8-4036-4d22-b9d8-695761306eda admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.409049 Aug 24 16:33:17.547888 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 24 16:33:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:33:18.533748 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:18.534763 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 24 16:33:18.535298 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:33:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:33:19.073112 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-a80aa328-f405-4eef-8c98-a7396f9aee1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:33:19.091609 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-a80aa328-f405-4eef-8c98-a7396f9aee1e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.418001 Aug 24 16:33:19.092198 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 24 16:33:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:33:20.109795 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:20.110823 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 24 16:33:20.111225 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:33:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:33:20.641898 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-ac6d8012-ebda-4f75-ab26-dd6bf30e0f9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:33:20.661366 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-ac6d8012-ebda-4f75-ab26-dd6bf30e0f9d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.409553 Aug 24 16:33:20.661944 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 24 16:33:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:33:21.634837 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:21.635853 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 24 16:33:21.636311 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:33:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:33:22.193451 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-c4e36533-3472-496c-9f95-a8716c4b8dd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:33:22.211916 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-c4e36533-3472-496c-9f95-a8716c4b8dd8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.408778 Aug 24 16:33:22.212517 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 24 16:33:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:33:23.181825 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:23.182847 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 24 16:33:23.183247 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:33:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:33:23.705793 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-39b2c1a1-af50-48d7-b5c7-107f686da5d8 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:33:23.727543 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-39b2c1a1-af50-48d7-b5c7-107f686da5d8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405407 Aug 24 16:33:23.728173 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Aug 24 16:33:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:34:18.006624 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:34:18.007647 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-e4a2f701-1a0f-4b3c-8789-b80e8e3b542d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Aug 24 16:34:18.008083 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 16:34:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:34:18.018663 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:18.408354 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-8f5cbc5a-9645-4a70-98ac-d525f798ea8c admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:34:18.429939 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-8f5cbc5a-9645-4a70-98ac-d525f798ea8c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415652 Aug 24 16:34:18.430473 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 24 16:34:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:34:18.451369 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG dbcounter [-] [112143] Writing DB stats nova_api:SELECT=14 {{(pid=112143) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:18.455299 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-2d104618-b83f-473c-ad45-ee00c0d596c0 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:34:18.463540 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-2d104618-b83f-473c-ad45-ee00c0d596c0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013573 Aug 24 16:34:18.464104 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Aug 24 16:34:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:34:18.476479 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-8883a459-3bef-4750-98a2-0583175cd49c admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:34:18.484159 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-8883a459-3bef-4750-98a2-0583175cd49c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012165 Aug 24 16:34:18.484680 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Aug 24 16:34:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:34:18.496021 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-3eb5fac3-12d0-4bb5-a3d1-9fbcfd355ab5 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:34:18.503396 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-3eb5fac3-12d0-4bb5-a3d1-9fbcfd355ab5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010915 Aug 24 16:34:18.503916 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Aug 24 16:34:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:34:18.515123 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-78244f52-4b67-433b-be2e-a79a4a9c1008 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:34:18.522603 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-78244f52-4b67-433b-be2e-a79a4a9c1008 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011049 Aug 24 16:34:18.523142 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Aug 24 16:34:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:37:15.002752 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-3eb5fac3-12d0-4bb5-a3d1-9fbcfd355ab5 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:15.003769 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-3eb5fac3-12d0-4bb5-a3d1-9fbcfd355ab5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 24 16:37:15.004212 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:15.149436 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writing DB stats nova_api:SELECT=6 {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:15.310902 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-d5da8e4f-3470-4881-a862-008688932daa admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:15.313260 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:37:15.313260 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: warnings.warn(msg) Aug 24 16:37:15.314380 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-d5da8e4f-3470-4881-a862-008688932daa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:37:15.314886 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-d5da8e4f-3470-4881-a862-008688932daa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:37:15.315313 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-d5da8e4f-3470-4881-a862-008688932daa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:37:15.316078 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-d5da8e4f-3470-4881-a862-008688932daa admin admin] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:37:15.316528 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-d5da8e4f-3470-4881-a862-008688932daa admin admin] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:37:15.316946 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-d5da8e4f-3470-4881-a862-008688932daa admin admin] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:37:15.351333 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-d5da8e4f-3470-4881-a862-008688932daa admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203285 Aug 24 16:37:15.351894 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 16:37:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:16.186994 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-3eb5fac3-12d0-4bb5-a3d1-9fbcfd355ab5 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:16.188042 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-3eb5fac3-12d0-4bb5-a3d1-9fbcfd355ab5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 24 16:37:16.188472 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:16.386593 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-db6f61a8-b91f-46f1-b24e-83ae99449c33 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:16.389049 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:37:16.389049 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: warnings.warn(msg) Aug 24 16:37:16.390174 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-db6f61a8-b91f-46f1-b24e-83ae99449c33 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:37:16.390711 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-db6f61a8-b91f-46f1-b24e-83ae99449c33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:37:16.391269 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-db6f61a8-b91f-46f1-b24e-83ae99449c33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:37:16.392240 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-db6f61a8-b91f-46f1-b24e-83ae99449c33 admin admin] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:37:16.393369 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-db6f61a8-b91f-46f1-b24e-83ae99449c33 admin admin] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:37:16.393856 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-db6f61a8-b91f-46f1-b24e-83ae99449c33 admin admin] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:37:16.415159 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-db6f61a8-b91f-46f1-b24e-83ae99449c33 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085116 Aug 24 16:37:16.415725 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 16:37:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:37:27.767456 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-3eb5fac3-12d0-4bb5-a3d1-9fbcfd355ab5 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:27.768511 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-3eb5fac3-12d0-4bb5-a3d1-9fbcfd355ab5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 24 16:37:27.768910 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:27.911898 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writing DB stats nova_cell0:SELECT=4 {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:27.913490 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writing DB stats nova_cell1:SELECT=4 {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:27.914223 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG dbcounter [-] [112144] Writing DB stats nova_api:SELECT=8 {{(pid=112144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:27.964257 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-50d3382f-e382-4e6b-9a9f-f768382f020c admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:27.966623 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:37:27.966623 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: warnings.warn(msg) Aug 24 16:37:27.967739 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-50d3382f-e382-4e6b-9a9f-f768382f020c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:37:27.968249 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-50d3382f-e382-4e6b-9a9f-f768382f020c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:37:27.968684 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-50d3382f-e382-4e6b-9a9f-f768382f020c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:37:27.969401 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-50d3382f-e382-4e6b-9a9f-f768382f020c admin admin] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:37:27.969853 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-50d3382f-e382-4e6b-9a9f-f768382f020c admin admin] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:37:27.970276 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-50d3382f-e382-4e6b-9a9f-f768382f020c admin admin] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:37:27.996490 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-50d3382f-e382-4e6b-9a9f-f768382f020c admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089377 Aug 24 16:37:27.996993 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 16:37:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:37:28.837001 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: DEBUG nova.api.openstack.wsgi [None req-3eb5fac3-12d0-4bb5-a3d1-9fbcfd355ab5 admin admin] Calling method '>' {{(pid=112143) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:28.838004 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: INFO nova.api.openstack.requestlog [None req-3eb5fac3-12d0-4bb5-a3d1-9fbcfd355ab5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 24 16:37:28.838401 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: [pid: 112143|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 16:37:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:37:29.033473 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG nova.api.openstack.wsgi [None req-1267de50-784d-46ac-833e-f32698e86751 admin admin] Calling method '>' {{(pid=112144) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:37:29.035848 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:37:29.035848 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: warnings.warn(msg) Aug 24 16:37:29.036996 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-1267de50-784d-46ac-833e-f32698e86751 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:37:29.037955 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-1267de50-784d-46ac-833e-f32698e86751 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:37:29.038383 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-1267de50-784d-46ac-833e-f32698e86751 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:37:29.039090 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-1267de50-784d-46ac-833e-f32698e86751 admin admin] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:37:29.039533 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-1267de50-784d-46ac-833e-f32698e86751 admin admin] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:37:29.039964 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: DEBUG oslo_concurrency.lockutils [None req-1267de50-784d-46ac-833e-f32698e86751 admin admin] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112144) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:37:29.061663 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: INFO nova.api.openstack.requestlog [None req-1267de50-784d-46ac-833e-f32698e86751 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079695 Aug 24 16:37:29.062213 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: [pid: 112144|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 16:37:28 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:38:30.870835 dv-cinder-779578-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 16:38:30.871440 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: Wed Aug 24 16:38:30 2022 - graceful shutdown triggered... Aug 24 16:38:30.871879 dv-cinder-779578-5-iscsi devstack@n-api.service[112143]: Gracefully killing worker 1 (pid: 112143)... Aug 24 16:38:30.872293 dv-cinder-779578-5-iscsi devstack@n-api.service[112144]: Gracefully killing worker 2 (pid: 112144)... Aug 24 16:38:31.872520 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: worker 1 buried after 1 seconds Aug 24 16:38:31.873095 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: worker 2 buried after 1 seconds Aug 24 16:38:31.873095 dv-cinder-779578-5-iscsi devstack@n-api.service[112142]: goodbye to uWSGI. Aug 24 16:38:31.874145 dv-cinder-779578-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 16:38:31.874699 dv-cinder-779578-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 16:38:31.877517 dv-cinder-779578-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 16:38:31.887535 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 16:38:31.889444 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 16:38:31 2022] *** Aug 24 16:38:31.889444 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 16:38:31.889444 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 16:38:31.889444 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: nodename: dv-cinder-779578-5-iscsi Aug 24 16:38:31.889444 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: machine: x86_64 Aug 24 16:38:31.889444 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: clock source: unix Aug 24 16:38:31.889444 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: pcre jit disabled Aug 24 16:38:31.889444 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: detected number of CPU cores: 4 Aug 24 16:38:31.889444 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: current working directory: / Aug 24 16:38:31.889444 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: detected binary path: /usr/bin/uwsgi-core Aug 24 16:38:31.890128 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: your processes number limit is 47680 Aug 24 16:38:31.890128 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: your memory page size is 4096 bytes Aug 24 16:38:31.890128 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: detected max file descriptor number: 2048 Aug 24 16:38:31.890128 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: lock engine: pthread robust mutexes Aug 24 16:38:31.890128 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: thunder lock: enabled Aug 24 16:38:31.890128 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 16:38:31.890128 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 16:38:31.930439 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: Python main interpreter initialized at 0x5584b83079c0 Aug 24 16:38:31.930439 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: python threads support enabled Aug 24 16:38:31.930439 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: your server socket listen backlog is limited to 100 connections Aug 24 16:38:31.930439 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: your mercy for graceful operations on workers is 90 seconds Aug 24 16:38:31.930987 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 16:38:31.930987 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: *** Operational MODE: preforking *** Aug 24 16:38:31.931166 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: *** uWSGI is running in multiple interpreter mode *** Aug 24 16:38:31.931166 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: spawned uWSGI master process (pid: 127152) Aug 24 16:38:31.931361 dv-cinder-779578-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 16:38:31.933644 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: spawned uWSGI worker 1 (pid: 127165, cores: 1) Aug 24 16:38:31.933644 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: spawned uWSGI worker 2 (pid: 127166, cores: 1) Aug 24 16:38:31.933644 dv-cinder-779578-5-iscsi devstack@n-api.service[127152]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 16:38:32.610207 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:38:32.621092 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 16:38:33.882354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:38:33.882354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: from cryptography.utils import int_from_bytes Aug 24 16:38:33.883142 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:38:33.883142 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: from cryptography.utils import int_from_bytes Aug 24 16:38:33.900357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:38:33.900357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: from cryptography.utils import int_from_bytes Aug 24 16:38:33.900964 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:38:33.900964 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: from cryptography.utils import int_from_bytes Aug 24 16:38:36.396790 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:38:36.397360 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:38:36.397573 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:38:36.398463 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:38:36.399115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:38:36.399115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.399414 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.399527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:38:36.399910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.400110 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:38:36.400238 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.400389 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:38:36.400529 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.400728 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:38:36.400849 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.400986 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:38:36.401155 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.401375 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.401469 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.401706 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.401806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.402031 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.402134 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.402349 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.402452 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.402681 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-5-iscsi {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.402812 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.403008 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.403116 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.403321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.403446 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.403637 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.403775 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.404016 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.404123 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.404295 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.404402 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.404620 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.404722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.404928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.405045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-5-iscsi {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.405327 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.405426 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.405641 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.406214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.406399 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.406537 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.406718 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.406846 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.407036 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.407174 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.407383 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.407549 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.407702 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.407994 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.408116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.408312 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.408412 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.408622 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.408744 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.408935 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.409044 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.409260 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.409351 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.409576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.409677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-5-iscsi {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.409889 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.410094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.410287 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.410479 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.410679 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.410829 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.410937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.411030 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.411121 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.411332 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.411502 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-5-iscsi {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.411657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.411822 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.412006 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.412158 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.412286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.412471 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.412583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.412888 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.412988 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.413205 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.413306 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.413614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.414254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.414432 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.414530 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.414762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.414891 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.415092 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.415289 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.415441 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.415590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.415731 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.415873 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.416039 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.416177 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.416327 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.416477 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.416623 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.416776 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.416876 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.417026 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.417156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.417344 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.417478 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.417665 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.417801 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.417975 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.418076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.418294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.418490 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.418614 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.418885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.418976 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.419203 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.419285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.419529 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.419664 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.419875 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.420215 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.420336 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.420526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.420643 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.420836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.420937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.421139 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.421248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.421442 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.421542 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.421761 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.421862 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.422074 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.422191 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.422385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.422491 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.422689 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.422785 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.422994 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.423124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.423420 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.423576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.423669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.423896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.424014 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.424235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.424341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.424547 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.424666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.424955 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.425061 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.425250 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.425354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.425506 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.425595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.425816 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.425905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.426138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.426232 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.426484 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.426575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.426779 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.426859 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.427090 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.427182 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.427462 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.427566 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.427685 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.427774 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.428011 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.428099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.428326 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.428424 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.428648 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.428748 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.428959 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.429041 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.429410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.429905 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.429991 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.430075 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.430151 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.430231 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.430344 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.430435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.430657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.430807 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.430930 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.431022 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.431237 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.431327 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.431550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.431647 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.431891 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.432093 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.432189 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.432272 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.432498 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.432590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.432807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.432890 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.433207 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.433314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.433400 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.433473 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.434256 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.434378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.434455 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.434534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.434615 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.434689 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.434773 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.434853 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.434953 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.435050 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.435361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.435465 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.435549 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.435631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.435810 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.435892 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.436358 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.436453 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.436526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.436802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.437509 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.437727 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.437889 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.438029 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.438168 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.438329 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.438469 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.438619 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.438774 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.438774 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.439061 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.439061 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.439269 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.439269 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.439564 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.439705 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.439861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.440042 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.440417 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.440523 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.440601 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.440601 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.440737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.440809 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.440809 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.440945 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.441019 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.441097 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.441717 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.441826 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.441903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.442299 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.442472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.442621 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.442765 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.442915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.443068 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.443387 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.443552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.443707 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.443857 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.444049 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.444209 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.444361 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.444506 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.444650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.444800 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.445772 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.445948 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.446119 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.446119 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.446404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.446554 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.446698 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.446855 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.446999 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.447143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.447292 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.447437 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.447588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.447759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:38:36.447996 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.448161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.448320 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.448473 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.448626 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.448777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.448922 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.449064 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.449218 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.449367 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.449525 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.449680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.449680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.449978 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.450128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.450281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.450432 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.450575 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.450718 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.450861 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.451012 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.451169 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.451326 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.451488 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.451632 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.451774 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.451928 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.452109 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.452265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.452519 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.452677 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.452821 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.452963 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.453106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.453264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.453569 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.453734 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.453734 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.454022 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.454187 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.454346 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.454497 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.454642 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.454791 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.454933 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.455086 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.455243 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.455243 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.455521 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.455845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.456143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.456365 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.456680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.456680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.456965 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.457116 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.457260 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.457416 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.457567 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.457710 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.458416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.458573 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.458716 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.458942 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.459100 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.459245 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.459398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.459541 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.459692 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.459849 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.460060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.460219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.460934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.461533 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.461700 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.461845 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.461988 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.462150 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.462304 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.462449 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.462449 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.462849 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.462993 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.463146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.463290 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.463431 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.463734 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.463894 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.464111 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.464257 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.464411 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.464555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.464707 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.464858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.465008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.465008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.465008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.465008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.465560 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.465760 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.465760 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.466359 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.466516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.466516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.466812 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.466812 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.467083 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.467233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.467233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.467529 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.467748 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.468015 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.468277 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.468667 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.468929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.469203 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.469386 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.469534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.469677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.469822 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.469965 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.470117 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.470264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.470264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.470543 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.470686 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.470844 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.470844 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.471142 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.471285 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.471932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.472142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.472142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.472436 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.472588 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.472588 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.472995 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.473146 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.473146 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.473442 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.473442 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.473895 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.474046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.474046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.474332 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.474478 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.474478 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.474750 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.474892 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.475053 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.475373 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.475523 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.475742 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.477018 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.477294 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.477556 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.477815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.478059 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.478303 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.478555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.478969 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.479606 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.479774 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.479928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.480100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.482744 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.482921 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.483206 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.483368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.483522 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.483667 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.484080 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.484080 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.484409 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.484686 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.484686 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.485615 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.485768 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.485928 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.486091 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.486235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.486377 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.486579 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.486730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.487161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.487322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.488090 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.488265 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.488413 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.488635 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.488827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.489074 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.489811 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.489970 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.490123 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.490945 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.491100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.491245 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.491389 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.491563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.491713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.491713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.492589 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.492743 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.492908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.492908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.493189 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.493342 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.493486 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.493637 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.493808 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.494208 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.494359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.494518 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.494663 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.494805 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.494948 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.495110 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.495265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.495265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.495543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.495693 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.495844 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.496103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.496293 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.496440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.496608 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.497499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.497657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.497818 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.498007 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.498165 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.498317 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.498461 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.498611 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.498755 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.498913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.499078 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.499296 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.499451 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.499603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.499756 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.499900 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.500106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.500253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.500396 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.500545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.500773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.500920 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.501079 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.501228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.501371 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.501513 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.501513 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.501799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.501949 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.502112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.502270 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.502414 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.502565 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.502718 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.502861 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.503011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.503160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.503303 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.503455 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.503597 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.503747 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.503939 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.504804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.504974 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.505130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.505283 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.505427 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.505570 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.505712 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.505864 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.506016 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.506160 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.506309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.506479 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.506721 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.506882 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.507027 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.507208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.508306 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.508471 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.508631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.508790 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.508942 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.509094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.509244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.509490 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.509655 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.509813 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.509957 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.510099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.510248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.510391 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.510543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.510694 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.510845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.510996 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.511139 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.511281 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.511432 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.511593 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.511761 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.511912 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.512081 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.512236 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.512394 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.512538 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.512688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.512833 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.512976 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.513127 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.513271 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.513413 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.513555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.513715 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.513715 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.514060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.514060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.514523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.514950 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.515114 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.515259 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.515420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.515420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.515701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.515701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.516278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.516435 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.516588 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.516741 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.516885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.516885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.517165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.517316 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.517467 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.517467 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.517785 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.518026 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.518184 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.518184 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.518693 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.518837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.518980 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.518980 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.519258 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.519411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.519656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.519806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.519969 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.520131 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.520276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.520871 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.521039 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.521196 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.521348 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.521504 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.521648 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.521800 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.522020 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.522177 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.522330 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.522483 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.522641 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.523309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.523470 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.524158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.524320 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.524672 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.524672 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.525243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.525400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.525544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.525698 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.525860 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.525860 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.526275 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.526532 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.526532 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.526847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.527004 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.527148 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.527148 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.527417 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.527569 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.527720 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.527873 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.528137 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.528296 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.528462 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.528782 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.528945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.529111 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.529265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.529410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.529561 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.529810 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.529961 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.530105 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.530257 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.530401 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.530557 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.531116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.531280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.531437 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.531599 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.531749 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.531901 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.532118 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.532263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.532419 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.532572 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.532725 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.532870 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.533013 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.533165 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.533318 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.533318 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.533602 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.533754 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.533908 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.534060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.534214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.534214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.534485 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.534710 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.534938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.535095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.535354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.535527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.535681 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.535825 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.535996 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.536174 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.536396 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.536553 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.537218 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.537384 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.537531 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.537686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.537839 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.537985 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.538158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.538414 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.540719 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.541107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.541107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.541416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.541416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.541756 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.541756 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.542057 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.542057 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.542333 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.542476 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.542641 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.542842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.543000 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.543000 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.543287 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.543431 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.543574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.543732 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.543890 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.544068 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.544211 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.544350 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.544482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.544620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.544768 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.544931 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.545181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.545352 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.545616 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.545776 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.545987 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.546144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.546291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.546434 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.546690 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.546811 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.546932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.547082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.547082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.547082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.547082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.547082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.547692 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.547822 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.547980 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.548150 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.548288 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.548538 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.548664 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.548803 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.548934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.549071 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.549245 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.549384 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.549514 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.549651 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.549789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.549932 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.550063 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.550199 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.550345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.550747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.550892 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.551033 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.551173 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.551330 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.551464 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.551605 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.551735 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.551877 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.552044 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.552195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.552327 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.552463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.552608 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.553247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.553413 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.553545 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.553675 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.553806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.553934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.554616 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.554764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.555629 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.555773 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.555914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.556082 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.556237 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.556463 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.556597 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.556808 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.556942 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.557083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.557221 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.557351 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.557481 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.557637 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.557776 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.557920 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.558059 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.558189 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.558331 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.558331 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.558671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.558805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.558944 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.559074 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.559210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.559348 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.559348 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.559610 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.559739 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.559739 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.559739 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.560184 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.560325 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.560455 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.560605 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.560973 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.561112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.561243 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.561428 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.561428 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.561704 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.561839 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.561968 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.562111 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.562111 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.562371 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.562501 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.562501 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.562750 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.562897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.562897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.563143 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.563280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.563280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.563532 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.563672 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.563672 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.563939 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.566250 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.566250 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.567314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.567446 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.567446 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.567670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.567773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.567773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.567972 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.568105 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.568219 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.568331 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.568331 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.568555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.568699 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.568908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.569026 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.569026 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.569248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.569366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.569492 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.570243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.570603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.571255 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.571255 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.571582 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.571775 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.571775 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572042 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572160 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572382 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572382 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572718 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572837 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572956 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572956 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.572956 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.573288 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.573399 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.573509 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.573670 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.573670 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.573908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.574027 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.574027 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.574241 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.574390 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.574512 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.574626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.574626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.574839 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.574957 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.575074 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.575198 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.575198 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.575426 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.575537 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.575537 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.575792 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.576005 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.576124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.576234 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.576234 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.576473 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.576594 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.576707 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.576819 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.576954 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.577166 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.577166 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.577551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.577667 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.577787 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.577898 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.578017 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.578128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.578248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.578368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.578368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.578592 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.578703 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.578822 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.579034 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.579034 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.579034 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.579371 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.579482 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.579607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.579720 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.579838 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.579975 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.580112 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.580242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.580365 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.580491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.580603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.580721 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.580721 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.580937 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.581057 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.581319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.581463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.581662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.581797 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.581924 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.582046 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.582158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.582269 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.582416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.582541 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.582661 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.582773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.582890 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.583008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.583122 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.583233 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.583354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.583466 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.583584 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.583703 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.583815 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.583932 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.584085 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.584214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.584334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.584454 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.584580 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.584700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.584819 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.584931 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.585049 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.585175 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.585360 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.585997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.586200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.586319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.586431 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.586552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.586552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.586770 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.586881 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.586992 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.587127 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.587324 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.587543 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.587663 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.587790 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.587910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.588083 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.588217 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.588332 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.588451 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.588565 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.588565 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.588787 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.588912 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.589044 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.589243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.589361 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.589473 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.589598 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.589712 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.589823 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.589933 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.590043 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.590160 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.590285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.590285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.590534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.590657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.590769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.590769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.590984 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.591104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.591221 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.591488 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.591610 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.591831 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.591990 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.592129 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.592260 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.592373 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.592493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.592661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.592783 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.592783 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.593007 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.593120 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.593239 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.593239 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.593462 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.593574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.593684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.593795 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.593904 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.594023 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.594023 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.594245 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.594358 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.594469 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.594588 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.594588 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.594805 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.594924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.595043 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.595163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.595356 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.595479 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.595599 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.595719 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.595838 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.596027 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.596240 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.596440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.596564 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.596685 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.596798 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.596909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.597036 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.597149 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.597267 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.597468 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.597696 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.597816 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.598023 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.598145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.598263 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.598382 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.598494 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.598657 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.598772 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.598890 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.599002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.600048 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.600199 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.600328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.600328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.600328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.600641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.600759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.600912 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.601040 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.601964 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.602098 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.602226 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.602354 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.602467 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.602467 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.602696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.602815 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.602926 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.603036 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.603156 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.603156 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.603379 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.603498 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.603609 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.603719 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.603841 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.604113 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.604254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.604369 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.604480 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.604600 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.604722 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.604837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.604956 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.605075 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.605186 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.605310 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.605430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.605550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.605669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.605780 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.605899 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.606019 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.606131 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.606249 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.606370 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.606574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.606832 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.606975 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.607247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.607247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.607486 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.607791 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.607977 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.608118 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.608243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.608356 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.608475 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.608593 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.608731 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.608892 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.609004 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.609115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.609235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.609347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.609471 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.609591 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.609710 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.609869 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.610013 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.610222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.610343 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.610455 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.610574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.610693 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.610805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.610925 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.611037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.611163 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.611283 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.611403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.611515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.611640 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.611769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.612092 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.612374 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.612495 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.612608 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.612731 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.612843 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.612963 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.613074 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.613193 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.613193 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.613193 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.613558 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.613677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.613789 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.613907 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.614037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.614196 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.614321 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.614475 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.614596 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.614596 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.614835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.615011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.615130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.615130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.615352 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.615506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.615639 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.615759 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.615759 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.615993 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.616123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.616294 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.616412 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.617277 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.617865 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.618084 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.618210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.618372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.618490 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.618608 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.618728 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.618841 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.618952 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.619075 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.619187 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.619314 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.619314 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.619522 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.619641 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.619789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.619906 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.620077 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.620212 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.620403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.620540 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.620660 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.620773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.620890 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.621004 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.621124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.621124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.621340 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.621452 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.621571 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.621682 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.621837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.621974 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.622239 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.622494 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.622625 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.623376 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.623505 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.623627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.623749 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.623907 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.624060 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.624183 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.624295 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.624408 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.624541 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.624693 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.624811 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.624933 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.625044 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.625173 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.625295 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.625420 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.625533 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.625643 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.625790 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.625918 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.626032 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.626144 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.626264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.626376 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.626523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.626523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.626767 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.626914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.627033 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.627178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.627383 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.627513 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.627634 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.627747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.628090 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.628309 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.628435 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.628558 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.628701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.628817 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.628936 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.629669 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.629809 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.629934 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.630091 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.630245 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.630389 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.630638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.630768 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.630891 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.631039 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.631185 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.631324 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.631456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.631594 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.631732 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.631850 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.631982 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.631982 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.634426 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635488 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635634 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635750 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.635863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.636834 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.636834 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637568 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637649 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637799 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.637871 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.638139 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.638236 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.638338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.638652 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.639250 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.639769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.640008 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.640334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.640488 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.640726 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.640863 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.640994 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.641148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.641285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.641690 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.641841 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.641968 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.642100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.642246 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.642377 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.642507 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.642644 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.642805 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.643136 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.643300 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.643434 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.643572 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.643716 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.643984 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.644122 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.644267 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.644396 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.644545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.644670 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.644796 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.644930 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.645069 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.645199 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.645329 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.645466 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.645624 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.645767 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.645941 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.646084 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.646269 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.646412 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.646593 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.646736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.646954 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.647097 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.647263 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.647397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.647585 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.647785 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.648376 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.648376 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.648849 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.648849 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.649127 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.649259 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.649389 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.649389 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.649644 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.649774 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.649912 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.650089 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.650226 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.650357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.650486 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.650624 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.650871 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.651008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.651140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.651279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.651417 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.651555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.651697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.651836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.652002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.652135 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.652278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.652551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.652685 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.652867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.652992 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.653351 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.653492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.653634 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.653765 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.653894 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.654122 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.654264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.654397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.654610 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.654751 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.654882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.655011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.655149 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.655289 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.655421 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.655550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.655686 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.656120 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.656256 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.656401 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.656576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.656715 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.656844 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.656974 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.657110 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.657250 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.657404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.657539 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.657716 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.657851 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.658027 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.658162 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.658372 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.658589 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.658732 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.658978 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.659123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.659263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.659401 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.659534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.659665 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.659794 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.659938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.660093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.660258 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.660390 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.660559 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.660713 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.660867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.661089 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.661225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.661355 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.661484 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.661622 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.661762 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.661917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.662051 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.662241 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.662376 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.662554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.662696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.662874 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.663008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.663252 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.663936 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.664283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.664428 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.664428 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.664702 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.664833 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.664968 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.665106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.665236 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.665366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.665494 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.665612 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.665736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.665736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.665946 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.666058 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.666169 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.666281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.666401 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.666514 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.666631 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.666743 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.666861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.667027 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.667153 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.667319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.667447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.667624 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.667751 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.667933 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.668085 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.668260 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.668390 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.668620 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.668817 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.668948 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.669167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.669295 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.669415 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.669528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.669647 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.669843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.669965 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.670158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.670331 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.670456 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.670598 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.670752 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.670886 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.671139 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.671286 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.671418 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.671558 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.671690 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.671828 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.671974 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.672251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.672374 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.672559 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.672710 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.672887 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.673014 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.673205 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.673354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.673579 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.673798 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.673941 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.674074 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.674216 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.674462 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.674598 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.674729 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.674858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.674988 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.675126 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.675271 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.675412 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.675544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.675673 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.675811 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.675988 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.676136 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.676277 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.676398 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.676594 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.676728 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.676908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.677038 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.677219 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.677340 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.677531 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.677665 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.677841 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.678079 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.678219 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.678421 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.678569 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.678760 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.679529 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.680312 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.680497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.680646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.680788 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.680929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.681062 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.681210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.681413 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.681555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.681688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.681831 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.681831 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:38:36.682085 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.682085 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.682331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.682459 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.682774 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.683086 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.683399 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.683722 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.684057 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.684372 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.684691 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.685008 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.685334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.685659 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.685969 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.686294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.686619 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.687011 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.687310 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.687655 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.688004 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.688324 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.688664 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.689012 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:38:36.689190 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:38:36.744372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO dbcounter [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Registered counter for database nova_api Aug 24 16:38:36.751870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO dbcounter [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Registered counter for database nova_api Aug 24 16:38:36.767415 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_db.sqlalchemy.engines [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:38:36.772729 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_db.sqlalchemy.engines [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:38:36.782589 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writer thread running {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:38:36.783858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writer thread running {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:38:36.841771 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.context [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),be07c2cf-28a6-420b-a09a-b6459fa4f88c(cell1) {{(pid=127165) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:38:36.842590 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.context [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),be07c2cf-28a6-420b-a09a-b6459fa4f88c(cell1) {{(pid=127166) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 16:38:36.845897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:38:36.846372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:38:36.846649 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:38:36.847128 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:38:36.848025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:38:36.848745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:38:36.848861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:38:36.849210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:38:36.849500 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:38:36.849951 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:38:36.851900 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:38:36.852570 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:38:36.853936 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO dbcounter [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Registered counter for database nova_cell0 Aug 24 16:38:36.854573 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO dbcounter [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Registered counter for database nova_cell0 Aug 24 16:38:36.857966 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO dbcounter [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Registered counter for database nova_cell1 Aug 24 16:38:36.858707 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO dbcounter [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Registered counter for database nova_cell1 Aug 24 16:38:36.865555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_db.sqlalchemy.engines [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:38:36.867664 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_db.sqlalchemy.engines [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:38:36.870098 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_db.sqlalchemy.engines [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:38:36.871463 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_db.sqlalchemy.engines [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:38:36.875305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writer thread running {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:38:36.877416 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writer thread running {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:38:36.877534 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writer thread running {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:38:36.879934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writer thread running {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:38:37.035002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO dbcounter [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Registered counter for database nova_cell0 Aug 24 16:38:37.042891 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO dbcounter [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Registered counter for database nova_cell0 Aug 24 16:38:37.044433 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_db.sqlalchemy.engines [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:38:37.049179 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writer thread running {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:38:37.050405 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_db.sqlalchemy.engines [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:38:37.055305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writer thread running {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:38:37.381947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: WARNING keystonemiddleware.auth_token [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:38:37.388255 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: WARNING keystonemiddleware.auth_token [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:38:37.389876 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: WARNING keystonemiddleware.auth_token [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:38:37.395635 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: WARNING keystonemiddleware.auth_token [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:38:37.742242 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: WARNING keystonemiddleware.auth_token [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:38:37.748404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: WARNING keystonemiddleware.auth_token [None req-9a0ac37b-db80-4431-9215-2667b8dffe2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:38:37.753755 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584b83079c0 pid: 127166 (default app) Aug 24 16:38:37.759050 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: WARNING keystonemiddleware.auth_token [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 16:38:37.765114 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: WARNING keystonemiddleware.auth_token [None req-f9cf4034-63e5-4354-891c-717f02deda69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 16:38:37.770517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584b83079c0 pid: 127165 (default app) Aug 24 16:39:14.762234 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:14.764124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:14.765306 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:14.766214 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:15.535160 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:15.542639 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:15.547074 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:15.551210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:16.806504 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-cd5a0742-6f11-42b7-98cc-db85da8e2c8c tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Action: 'create', calling method: .version_select at 0x7f0640b3e8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1427873769", "metadata": {"Type": "work"}}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-cd5a0742-6f11-42b7-98cc-db85da8e2c8c tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Request method failure captured: Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 122 Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQyrjjARMBmPgzx07TQAUn7HHjzevIF9jzllX4hWE8vn8m61u1_E11eqFmGmcfNMyn3Tn9ef02cclZ4Zr-I15B-fC-i6H8fElW7ETdEJynsndgtdqtq6KEuqEVocSlbRlsPnZn6hUSFMtWXAPnrvbIt-KULYP9JdZpP77FT6P8rvM0 Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:39:16.831903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83bac1da3fae45278144ba6c555629cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 1ad05e879f994f0693f2b00e52b6b21f Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1427873769", "metadata": {"Type": "work"}}} Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: Aug 24 16:39:16.833583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1427873769', 'metadata': {'Type': 'work'}}}} Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise error Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:39:16.835094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 16:39:16.836612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 16:39:16.838005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 16:39:16.838005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.838005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-cd5a0742-6f11-42b7-98cc-db85da8e2c8c tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:39:16.838005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-cd5a0742-6f11-42b7-98cc-db85da8e2c8c tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.114204 Aug 24 16:39:16.847302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 24 16:39:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:39:16.862821 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-42fc4f77-1d4a-498d-8c33-433a254c3b34 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Action: 'create', calling method: .version_select at 0x7f0640b3e940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-630035569", "metadata": {"Type": "work"}}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-42fc4f77-1d4a-498d-8c33-433a254c3b34 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Request method failure captured: Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 119 Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQyrjjARMBmPgzx07TQAUn7HHjzevIF9jzllX4hWE8vn8m61u1_E11eqFmGmcfNMyn3Tn9ef02cclZ4Zr-I15B-fC-i6H8fElW7ETdEJynsndgtdqtq6KEuqEVocSlbRlsPnZn6hUSFMtWXAPnrvbIt-KULYP9JdZpP77FT6P8rvM0 Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:39:16.874730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83bac1da3fae45278144ba6c555629cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 1ad05e879f994f0693f2b00e52b6b21f Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-630035569", "metadata": {"Type": "work"}}} Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: Aug 24 16:39:16.876334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-630035569', 'metadata': {'Type': 'work'}}}} Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise error Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi '0' Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:39:16.877254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 16:39:16.878745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 16:39:16.880123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 16:39:16.880123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.880123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-42fc4f77-1d4a-498d-8c33-433a254c3b34 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:39:16.880365 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-42fc4f77-1d4a-498d-8c33-433a254c3b34 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028372 Aug 24 16:39:16.884615 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 2/2] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 24 16:39:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:39:16.907280 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4e18c9e6-9f33-481c-9cf1-241f66b7dcc2 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Action: 'create', calling method: .version_select at 0x7f06409fc430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1353324597", "metadata": {"Type": "work"}}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4e18c9e6-9f33-481c-9cf1-241f66b7dcc2 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Request method failure captured: Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 119 Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQyrjjARMBmPgzx07TQAUn7HHjzevIF9jzllX4hWE8vn8m61u1_E11eqFmGmcfNMyn3Tn9ef02cclZ4Zr-I15B-fC-i6H8fElW7ETdEJynsndgtdqtq6KEuqEVocSlbRlsPnZn6hUSFMtWXAPnrvbIt-KULYP9JdZpP77FT6P8rvM0 Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:39:16.930947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83bac1da3fae45278144ba6c555629cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 1ad05e879f994f0693f2b00e52b6b21f Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1353324597", "metadata": {"Type": "work"}}} Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: Aug 24 16:39:16.932347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1353324597', 'metadata': {'Type': 'work'}}}} Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise error Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi '' Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:39:16.933130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 16:39:16.934557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 16:39:16.935662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 16:39:16.935662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:16.935662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4e18c9e6-9f33-481c-9cf1-241f66b7dcc2 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:39:16.935662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-4e18c9e6-9f33-481c-9cf1-241f66b7dcc2 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.038097 Aug 24 16:39:16.937179 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 3/3] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 24 16:39:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:39:16.960326 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-602802ef-342a-4d3d-8a79-de24c76fa05e tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Calling method '.version_select at 0x7f06409fce50>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:17.541011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9571993a-b895-47fa-a6ab-21964361e981 tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] Action: 'create', calling method: .version_select at 0x7f0640b3f8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-278603029", "metadata": {"Type": "work"}}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:17.800646 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-602802ef-342a-4d3d-8a79-de24c76fa05e tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] HTTP exception thrown: Volume tempest-invalid-866950579 could not be found. Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-602802ef-342a-4d3d-8a79-de24c76fa05e tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Request method failure captured: Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-866950579 HTTP/1.1 Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQyrjjARMBmPgzx07TQAUn7HHjzevIF9jzllX4hWE8vn8m61u1_E11eqFmGmcfNMyn3Tn9ef02cclZ4Zr-I15B-fC-i6H8fElW7ETdEJynsndgtdqtq6KEuqEVocSlbRlsPnZn6hUSFMtWXAPnrvbIt-KULYP9JdZpP77FT6P8rvM0 Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:39:17.805845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83bac1da3fae45278144ba6c555629cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 1ad05e879f994f0693f2b00e52b6b21f Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Volume tempest-invalid-866950579 could not be found. Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'tempest-invalid-866950579'} Aug 24 16:39:17.808281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-866950579 could not be found. (HTTP 404) (Request-ID: req-467c42f6-2af9-4f5c-a301-1b22d25d2e99) Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:17.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:39:17.810554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-866950579 could not be found. Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:39:17.811868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-866950579 could not be found. Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-866950579 could not be found. Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-602802ef-342a-4d3d-8a79-de24c76fa05e tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Returning 404 to user: Volume tempest-invalid-866950579 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-602802ef-342a-4d3d-8a79-de24c76fa05e tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-866950579" status: 404 len: 98 microversion: 2.1 time: 0.865842 Aug 24 16:39:17.813368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 4/4] 10.222.0.52 () {58 vars in 1215 bytes} [Wed Aug 24 16:39:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-866950579 => generated 98 bytes in 868 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 16:39:17.828376 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d5dc9fc1-5e8c-45e2-b1b8-3712771f1d47 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013683 Aug 24 16:39:17.835785 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 5/5] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Aug 24 16:39:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 16:39:17.852406 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-33f92fcc-f298-47cd-81e6-4b45b9b9bd74 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015400 Aug 24 16:39:17.858261 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 6/6] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Aug 24 16:39:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 16:39:17.871513 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d69fb162-0183-4d06-b5f1-afcd9dd09346 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Calling method '.version_select at 0x7f0640930790>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:18.092508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-d69fb162-0183-4d06-b5f1-afcd9dd09346 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] HTTP exception thrown: Volume c62172e2-f67c-4b7f-ac3f-b9d5503b6caf could not be found. Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d69fb162-0183-4d06-b5f1-afcd9dd09346 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Request method failure captured: Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: DELETE /compute/v2.1/os-volumes/c62172e2-f67c-4b7f-ac3f-b9d5503b6caf HTTP/1.1 Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQyrjjARMBmPgzx07TQAUn7HHjzevIF9jzllX4hWE8vn8m61u1_E11eqFmGmcfNMyn3Tn9ef02cclZ4Zr-I15B-fC-i6H8fElW7ETdEJynsndgtdqtq6KEuqEVocSlbRlsPnZn6hUSFMtWXAPnrvbIt-KULYP9JdZpP77FT6P8rvM0 Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:39:18.095075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83bac1da3fae45278144ba6c555629cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 1ad05e879f994f0693f2b00e52b6b21f Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Volume c62172e2-f67c-4b7f-ac3f-b9d5503b6caf could not be found. Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'c62172e2-f67c-4b7f-ac3f-b9d5503b6caf'} Aug 24 16:39:18.096508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c62172e2-f67c-4b7f-ac3f-b9d5503b6caf could not be found. (HTTP 404) (Request-ID: req-31eae5cd-a977-4c51-bb88-f73cc290fb5c) Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:18.097497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:39:18.098927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c62172e2-f67c-4b7f-ac3f-b9d5503b6caf could not be found. Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 16:39:18.101807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c62172e2-f67c-4b7f-ac3f-b9d5503b6caf could not be found. Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c62172e2-f67c-4b7f-ac3f-b9d5503b6caf could not be found. Aug 24 16:39:18.103450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.105736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d69fb162-0183-4d06-b5f1-afcd9dd09346 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Returning 404 to user: Volume c62172e2-f67c-4b7f-ac3f-b9d5503b6caf could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:39:18.106889 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d69fb162-0183-4d06-b5f1-afcd9dd09346 tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/c62172e2-f67c-4b7f-ac3f-b9d5503b6caf" status: 404 len: 109 microversion: 2.1 time: 0.247481 Aug 24 16:39:18.108111 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 7/7] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 16:39:17 2022] DELETE /compute/v2.1/os-volumes/c62172e2-f67c-4b7f-ac3f-b9d5503b6caf => generated 109 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:39:18.122901 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-65c9e61e-b67e-49bd-9a95-6d442a28128a tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Calling method '.version_select at 0x7f06409303a0>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:18.453282 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-65c9e61e-b67e-49bd-9a95-6d442a28128a tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] HTTP exception thrown: Volume ae3e4a55-8225-4f11-b5a3-558058b9fc94 could not be found. Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-65c9e61e-b67e-49bd-9a95-6d442a28128a tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Request method failure captured: Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/os-volumes/ae3e4a55-8225-4f11-b5a3-558058b9fc94 HTTP/1.1 Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQyrjjARMBmPgzx07TQAUn7HHjzevIF9jzllX4hWE8vn8m61u1_E11eqFmGmcfNMyn3Tn9ef02cclZ4Zr-I15B-fC-i6H8fElW7ETdEJynsndgtdqtq6KEuqEVocSlbRlsPnZn6hUSFMtWXAPnrvbIt-KULYP9JdZpP77FT6P8rvM0 Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:39:18.456938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83bac1da3fae45278144ba6c555629cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83bac1da3fae45278144ba6c555629cb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 83bac1da3fae45278144ba6c555629cb Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-VolumesNegativeTest-1653371810 Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 1ad05e879f994f0693f2b00e52b6b21f Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-VolumesNegativeTest-1653371810-project Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Volume ae3e4a55-8225-4f11-b5a3-558058b9fc94 could not be found. Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'ae3e4a55-8225-4f11-b5a3-558058b9fc94'} Aug 24 16:39:18.458454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae3e4a55-8225-4f11-b5a3-558058b9fc94 could not be found. (HTTP 404) (Request-ID: req-5225349b-63d4-41d1-aed7-2d84bc14df4c) Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:18.459881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:39:18.461470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae3e4a55-8225-4f11-b5a3-558058b9fc94 could not be found. Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:39:18.462697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae3e4a55-8225-4f11-b5a3-558058b9fc94 could not be found. Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae3e4a55-8225-4f11-b5a3-558058b9fc94 could not be found. Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-65c9e61e-b67e-49bd-9a95-6d442a28128a tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] Returning 404 to user: Volume ae3e4a55-8225-4f11-b5a3-558058b9fc94 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-65c9e61e-b67e-49bd-9a95-6d442a28128a tempest-VolumesNegativeTest-1653371810 tempest-VolumesNegativeTest-1653371810-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/ae3e4a55-8225-4f11-b5a3-558058b9fc94" status: 404 len: 109 microversion: 2.1 time: 0.345028 Aug 24 16:39:18.463882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 8/8] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:39:18 2022] GET /compute/v2.1/os-volumes/ae3e4a55-8225-4f11-b5a3-558058b9fc94 => generated 109 bytes in 350 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:39:18.480576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-722c3734-cbfb-45e0-8da9-b95a3718de14 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f0640981d30>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:19.321297 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-722c3734-cbfb-45e0-8da9-b95a3718de14 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f970060d-c6b5-403f-8549-c05e166ef4e5" status: 200 len: 351 microversion: 2.1 time: 0.857058 Aug 24 16:39:19.322792 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 9/9] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:39:18 2022] GET /compute/v2.1/os-volumes/f970060d-c6b5-403f-8549-c05e166ef4e5 => generated 351 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:19.407493 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9571993a-b895-47fa-a6ab-21964361e981 tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.896691 Aug 24 16:39:19.408914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 1/10] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 24 16:39:15 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3902 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 16:39:19.426799 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-24b52bf5-7faa-467f-8d2c-c69c43759e9a tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] Calling method '.version_select at 0x7f0640930310>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:19.617780 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-24b52bf5-7faa-467f-8d2c-c69c43759e9a tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111" status: 200 len: 352 microversion: 2.1 time: 0.198495 Aug 24 16:39:19.618414 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 10/11] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:39:19 2022] GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 => generated 352 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:20.633918 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-43b64636-de6a-4ecb-b16a-3d593f7d9fed tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] Calling method '.version_select at 0x7f0640997700>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:20.833774 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-43b64636-de6a-4ecb-b16a-3d593f7d9fed tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111" status: 200 len: 353 microversion: 2.1 time: 0.205298 Aug 24 16:39:20.841965 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 2/12] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:39:20 2022] GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:20.851837 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d27df509-7e5c-48ce-9455-f94a88b1d30a tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] Calling method '.version_select at 0x7f0640942040>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:21.022533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d27df509-7e5c-48ce-9455-f94a88b1d30a tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111" status: 200 len: 353 microversion: 2.1 time: 0.178976 Aug 24 16:39:21.023561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 11/13] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:39:20 2022] GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:21.041552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-efa109fd-92ab-48f5-948b-2386dca3e8e7 tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] Calling method '.version_select at 0x7f0640997dc0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:21.300119 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-efa109fd-92ab-48f5-948b-2386dca3e8e7 tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111" status: 202 len: 0 microversion: 2.1 time: 0.263060 Aug 24 16:39:21.301201 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 3/14] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 16:39:21 2022] DELETE /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:39:21.316083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-92a9e0e4-f80d-47b0-a656-f25bd8ca08fa tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] Calling method '.version_select at 0x7f0640942700>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:21.463093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-92a9e0e4-f80d-47b0-a656-f25bd8ca08fa tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111" status: 200 len: 352 microversion: 2.1 time: 0.151583 Aug 24 16:39:21.465056 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 12/15] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:39:21 2022] GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 => generated 352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:21.655378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-647c76bd-f383-4ef4-b302-67ac9524b11d tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f06409aa4c0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:21.883681 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-647c76bd-f383-4ef4-b302-67ac9524b11d tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e7d2c0c0-d3ed-40bf-beec-17afe5af102f" status: 200 len: 351 microversion: 2.1 time: 0.232944 Aug 24 16:39:21.884352 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 4/16] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:39:21 2022] GET /compute/v2.1/os-volumes/e7d2c0c0-d3ed-40bf-beec-17afe5af102f => generated 351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:22.478730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1f4c8aa5-0c70-412c-9db8-3cdc4c9a9708 tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] Calling method '.version_select at 0x7f0640930670>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:22.548723 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-1f4c8aa5-0c70-412c-9db8-3cdc4c9a9708 tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] HTTP exception thrown: Volume 0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 could not be found. Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1f4c8aa5-0c70-412c-9db8-3cdc4c9a9708 tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] Request method failure captured: Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 HTTP/1.1 Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQztv1pCyjCyFnSrFV96mUMCoiiUM3CnKO43S3jqOIdP-IK1XCFiESaIdHwsQJ6zmVVIjzs_1WjgA6qQujjAKW7AF71LWP2SvfBpgzOV5HzAELMaW2l0LcIQSE_k0HeCPtrQcjz0vIYq0dXgMi5THP8gQl66uDmjKEuMEBAJuE1i-c Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 12724c76dc63440d970f4044ac3fadee Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-VolumesGetTestJSON-1251118424 Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:39:22.550887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/12724c76dc63440d970f4044ac3fadee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/12724c76dc63440d970f4044ac3fadee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/12724c76dc63440d970f4044ac3fadee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_12724c76dc63440d970f4044ac3fadee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-VolumesGetTestJSON-1251118424 Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 12724c76dc63440d970f4044ac3fadee Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-VolumesGetTestJSON-1251118424 Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-VolumesGetTestJSON-1251118424-project Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: f6835c202a804a1c8fb6fafd7fb8c307 Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-VolumesGetTestJSON-1251118424-project Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Volume 0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 could not be found. Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111'} Aug 24 16:39:22.552650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 could not be found. (HTTP 404) (Request-ID: req-a23abb18-7d26-4ac2-bafa-3bfcbc8d5cac) Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:22.554489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:39:22.555477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 could not be found. Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:39:22.556650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 could not be found. Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 could not be found. Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:39:22.557764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1f4c8aa5-0c70-412c-9db8-3cdc4c9a9708 tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] Returning 404 to user: Volume 0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:39:22.559172 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1f4c8aa5-0c70-412c-9db8-3cdc4c9a9708 tempest-VolumesGetTestJSON-1251118424 tempest-VolumesGetTestJSON-1251118424-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111" status: 404 len: 109 microversion: 2.1 time: 0.085196 Aug 24 16:39:22.559853 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 13/17] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:39:22 2022] GET /compute/v2.1/os-volumes/0d8ed5d1-95d9-4f06-aa1a-5a5a687e2111 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:39:23.696740 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-945961417", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "networks": [{"uuid": "ed061958-f92c-443f-b325-7cd0f8dbd76e"}]}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:23.781311 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f0c4e327-17eb-4ded-9a71-b69501131d70 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f06409300d0>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:23.845148 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f0c4e327-17eb-4ded-9a71-b69501131d70 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/425d3cfb-2b8c-4a96-a46c-373233ef4c87" status: 200 len: 351 microversion: 2.1 time: 0.069664 Aug 24 16:39:23.846140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 14/18] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:39:23 2022] GET /compute/v2.1/os-volumes/425d3cfb-2b8c-4a96-a46c-373233ef4c87 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:23.861032 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f5febfb6-5057-458a-8818-2ae9b8624af3 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f06409881f0>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:23.997274 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] validate_networks() for [('ed061958-f92c-443f-b325-7cd0f8dbd76e', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:39:24.110507 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f5febfb6-5057-458a-8818-2ae9b8624af3 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.253885 Aug 24 16:39:24.111016 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 15/19] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Aug 24 16:39:23 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:24.126990 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-51b1bf06-2300-4fb2-9685-6450620d2d8d tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f0640942a60>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:24.330738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-51b1bf06-2300-4fb2-9685-6450620d2d8d tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.207793 Aug 24 16:39:24.333051 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 16/20] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Aug 24 16:39:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:24.350137 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ddae30d6-b5a4-40df-a901-d8d98ef38974 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f0640960430>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:24.610527 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ddae30d6-b5a4-40df-a901-d8d98ef38974 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.265351 Aug 24 16:39:24.611326 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 17/21] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Aug 24 16:39:24 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:24.624721 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-307a1851-98c4-4dbe-9bf0-af773a53e18e tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f06409608b0>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:24.837068 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-307a1851-98c4-4dbe-9bf0-af773a53e18e tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.216175 Aug 24 16:39:24.838484 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 18/22] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Aug 24 16:39:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:39:24.856571 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ce91fc50-4b9b-4325-8479-df290815f850 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f06409424c0>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:24.980478 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ce91fc50-4b9b-4325-8479-df290815f850 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.132341 Aug 24 16:39:24.981400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 19/23] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Aug 24 16:39:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:24.994863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3bdb93b1-7549-43fb-8b59-46ca72814735 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f0640930f70>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:25.189735 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3bdb93b1-7549-43fb-8b59-46ca72814735 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.198685 Aug 24 16:39:25.190661 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 20/24] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Aug 24 16:39:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:25.205485 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a14d3752-1461-4825-b5b7-a2ae9fbdda9c tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f0640988160>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:25.404228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a14d3752-1461-4825-b5b7-a2ae9fbdda9c tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.203491 Aug 24 16:39:25.405241 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 21/25] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Aug 24 16:39:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:39:25.418950 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3c0b12b8-c638-4fef-9b39-b7271b293b13 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] Calling method '.version_select at 0x7f0640942a60>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:25.725609 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3c0b12b8-c638-4fef-9b39-b7271b293b13 tempest-VolumesTestJSON-1302510282 tempest-VolumesTestJSON-1302510282-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.309853 Aug 24 16:39:25.727118 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 22/26] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Aug 24 16:39:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:26.416887 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:39:26.417617 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:39:26.418762 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:39:26.419418 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:39:26.420267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:39:26.456838 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:26.457485 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:26.458082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:26.459363 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:26.460523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:26.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:26.565711 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Getting quotas for project 09380cc0f03944468d21fa2571e992d0. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:39:26.592956 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Getting quotas for user 05e175cab43245d7b35df0adc8564394 and project 09380cc0f03944468d21fa2571e992d0. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:39:26.657803 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:39:26.670653 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:39:26.840462 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-5d0cc069-418e-438c-9640-03e5d1278ccf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.713534 Aug 24 16:39:26.841774 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 5/27] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:39:26.853783 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0013d0db-26c7-445f-9954-0295c20508f9 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:26.855361 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0013d0db-26c7-445f-9954-0295c20508f9 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:27.191197 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0013d0db-26c7-445f-9954-0295c20508f9 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:27.229809 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0013d0db-26c7-445f-9954-0295c20508f9 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1214 microversion: 2.1 time: 0.378151 Aug 24 16:39:27.247233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 23/28] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:26 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1214 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:27.938876 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-09574624-32ca-4644-a129-b91494c67bde tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Action: 'create', calling method: .version_select at 0x7f06400431f0>, body: {"keypair": {"name": "tempest-keypair-15944065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIphOkHWdcqJ+oStbqENLzeiRKKNp3xQzD7gxdIm8lGfNt2vLVqYd3bbHnklJ7+2g3DqDoXPPPcXpLYXlYQpemlmJlrakDw4DzXN5Mqs5cC7bMpomI2dF5JKHy4HEwtaQ=="}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:28.044591 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-09574624-32ca-4644-a129-b91494c67bde tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Getting quotas for project cdf93612acce4a868bf2105a6567855b. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:39:28.060092 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-09574624-32ca-4644-a129-b91494c67bde tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Getting quotas for user 79d593b826c64087bac576d2204302b4 and project cdf93612acce4a868bf2105a6567855b. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:39:28.171319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-09574624-32ca-4644-a129-b91494c67bde tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.794086 Aug 24 16:39:28.173862 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 6/29] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Aug 24 16:39:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 801 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 16:39:28.256787 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-10b67a5e-cb8a-4797-b2c7-9de2b735b10f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:28.257415 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-10b67a5e-cb8a-4797-b2c7-9de2b735b10f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:28.410741 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-10b67a5e-cb8a-4797-b2c7-9de2b735b10f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:28.428908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-10b67a5e-cb8a-4797-b2c7-9de2b735b10f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1214 microversion: 2.1 time: 0.171090 Aug 24 16:39:28.445224 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 24/30] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:28 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:29.453949 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b7110c21-95c7-4144-8fdf-516acc0b02f9 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:29.454572 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b7110c21-95c7-4144-8fdf-516acc0b02f9 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:29.609167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b7110c21-95c7-4144-8fdf-516acc0b02f9 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:29.659489 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b7110c21-95c7-4144-8fdf-516acc0b02f9 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1214 microversion: 2.1 time: 0.212727 Aug 24 16:39:29.679093 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 7/31] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:29 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:30.691228 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d03e4abd-f13b-4810-8b67-14a7d8923f3c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:30.692659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d03e4abd-f13b-4810-8b67-14a7d8923f3c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:30.710522 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d03e4abd-f13b-4810-8b67-14a7d8923f3c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:30.711247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d03e4abd-f13b-4810-8b67-14a7d8923f3c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:30.711891 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d03e4abd-f13b-4810-8b67-14a7d8923f3c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:30.713552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d03e4abd-f13b-4810-8b67-14a7d8923f3c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:30.714297 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d03e4abd-f13b-4810-8b67-14a7d8923f3c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:30.714968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d03e4abd-f13b-4810-8b67-14a7d8923f3c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:30.915362 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-818452858", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:31.223246 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] validate_networks() for [('68fa56df-1aa3-4489-9841-9bef4d938e1c', None, None, None, None, None)] {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:39:31.510822 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d03e4abd-f13b-4810-8b67-14a7d8923f3c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:31.554066 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d03e4abd-f13b-4810-8b67-14a7d8923f3c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1266 microversion: 2.1 time: 0.871277 Aug 24 16:39:31.555006 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 8/32] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:30 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1266 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:32.581043 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b0ef880f-8005-40b8-a22d-d87a36587543 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:32.581757 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b0ef880f-8005-40b8-a22d-d87a36587543 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:32.588485 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0ef880f-8005-40b8-a22d-d87a36587543 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:32.600849 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0ef880f-8005-40b8-a22d-d87a36587543 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:32.601235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0ef880f-8005-40b8-a22d-d87a36587543 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:32.601986 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0ef880f-8005-40b8-a22d-d87a36587543 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:32.602450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0ef880f-8005-40b8-a22d-d87a36587543 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:32.602867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0ef880f-8005-40b8-a22d-d87a36587543 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:32.789055 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b0ef880f-8005-40b8-a22d-d87a36587543 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:32.798065 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b0ef880f-8005-40b8-a22d-d87a36587543 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1272 microversion: 2.1 time: 0.220645 Aug 24 16:39:32.799027 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 9/33] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:32 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:32.843889 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2003987746", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dd51ca4-bcd8-48ce-8f00-e968b2b4f315"}], "security_groups": [{"name": "tempest-securitygroup--611360239"}], "key_name": "tempest-keypair-15944065", "user_data": "}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:33.075766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] validate_networks() for [('5dd51ca4-bcd8-48ce-8f00-e968b2b4f315', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:39:33.366875 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:39:33.368420 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:39:33.369140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:39:33.369554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:39:33.370053 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:39:33.409523 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:33.410261 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:33.410710 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:33.411493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:33.412004 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:33.416307 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:33.509844 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Getting quotas for project 364a00263e804efe83ae759d9c4c01fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:39:33.528668 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Getting quotas for user fded55a41aae41c6af61382a7c35372e and project 364a00263e804efe83ae759d9c4c01fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:39:33.549943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:39:33.560366 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:39:33.744548 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-52de05f2-e34c-4769-abcc-f39fe4a286f2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.369679 Aug 24 16:39:33.752000 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 25/34] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:39:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 3373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:39:33.760233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8e16eafa-1f2e-453b-aab7-7556795cdc95 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:33.761334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8e16eafa-1f2e-453b-aab7-7556795cdc95 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:34.046234 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8e16eafa-1f2e-453b-aab7-7556795cdc95 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:34.089082 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8e16eafa-1f2e-453b-aab7-7556795cdc95 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1221 microversion: 2.1 time: 0.334934 Aug 24 16:39:34.090764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 26/35] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:33 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1221 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:34.098319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a5d0bb9c-1fe1-4491-957b-b458e0b68f92 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:34.099747 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a5d0bb9c-1fe1-4491-957b-b458e0b68f92 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:34.114787 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:39:34.116454 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:39:34.122697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:39:34.123335 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:39:34.124017 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:39:34.132794 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5d0bb9c-1fe1-4491-957b-b458e0b68f92 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:34.135077 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5d0bb9c-1fe1-4491-957b-b458e0b68f92 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:34.137383 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5d0bb9c-1fe1-4491-957b-b458e0b68f92 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:34.140366 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5d0bb9c-1fe1-4491-957b-b458e0b68f92 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:34.141015 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5d0bb9c-1fe1-4491-957b-b458e0b68f92 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:34.141633 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5d0bb9c-1fe1-4491-957b-b458e0b68f92 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:34.153092 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:34.155471 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:34.158033 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:34.159028 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:34.161375 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:34.163155 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:34.214735 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Getting quotas for project cdf93612acce4a868bf2105a6567855b. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:39:34.234307 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Getting quotas for user 79d593b826c64087bac576d2204302b4 and project cdf93612acce4a868bf2105a6567855b. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:39:34.299291 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:39:34.311028 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:39:34.510604 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e492a3f4-fe47-490f-b447-92230c8374c3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.671826 Aug 24 16:39:34.514831 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 10/36] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Aug 24 16:39:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 16:39:34.527788 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-797435690", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:34.548832 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a5d0bb9c-1fe1-4491-957b-b458e0b68f92 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:34.601905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a5d0bb9c-1fe1-4491-957b-b458e0b68f92 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1272 microversion: 2.1 time: 0.506406 Aug 24 16:39:34.604350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 27/37] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:34 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1272 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:34.618029 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e06296d4-7443-4a3e-86f5-bf883f0b45ef tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:34.628424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e06296d4-7443-4a3e-86f5-bf883f0b45ef tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:34.710481 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] validate_networks() for [('68fa56df-1aa3-4489-9841-9bef4d938e1c', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:39:34.785030 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e06296d4-7443-4a3e-86f5-bf883f0b45ef tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:34.808421 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e06296d4-7443-4a3e-86f5-bf883f0b45ef tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:34.829300 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e06296d4-7443-4a3e-86f5-bf883f0b45ef tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:34.835935 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e06296d4-7443-4a3e-86f5-bf883f0b45ef tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1280 microversion: 2.20 time: 0.225713 Aug 24 16:39:34.837109 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 28/38] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:34 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1280 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:35.625386 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8478b8d3-2b2e-42bf-b320-db22298911db tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:35.626192 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8478b8d3-2b2e-42bf-b320-db22298911db tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:35.636541 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8478b8d3-2b2e-42bf-b320-db22298911db tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:35.645855 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8478b8d3-2b2e-42bf-b320-db22298911db tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:35.648811 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8478b8d3-2b2e-42bf-b320-db22298911db tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:35.653617 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8478b8d3-2b2e-42bf-b320-db22298911db tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:35.656338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8478b8d3-2b2e-42bf-b320-db22298911db tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:35.657303 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8478b8d3-2b2e-42bf-b320-db22298911db tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:36.104667 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8478b8d3-2b2e-42bf-b320-db22298911db tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:36.125610 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8478b8d3-2b2e-42bf-b320-db22298911db tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1272 microversion: 2.1 time: 0.502694 Aug 24 16:39:36.138983 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 29/39] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:35 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1272 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:36.161179 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-23be145c-716f-4ffc-af48-29ce7e1d0b3f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:36.165065 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-23be145c-716f-4ffc-af48-29ce7e1d0b3f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:36.569278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-23be145c-716f-4ffc-af48-29ce7e1d0b3f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:36.590581 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-23be145c-716f-4ffc-af48-29ce7e1d0b3f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:36.599315 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-23be145c-716f-4ffc-af48-29ce7e1d0b3f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:36.605737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-23be145c-716f-4ffc-af48-29ce7e1d0b3f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1280 microversion: 2.20 time: 0.472274 Aug 24 16:39:36.625563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 30/40] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:36 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1280 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:36.909625 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:39:36.910439 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:39:36.910629 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:39:36.911219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:39:36.911853 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:39:36.929754 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:36.934743 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:36.935528 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:36.939561 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:36.941936 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:36.942593 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:37.004137 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Getting quotas for project 364a00263e804efe83ae759d9c4c01fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:39:37.019863 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Getting quotas for user fded55a41aae41c6af61382a7c35372e and project 364a00263e804efe83ae759d9c4c01fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:39:37.087831 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:39:37.097922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:39:37.153638 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f2a24af1-1b42-48a9-babb-2f1e906f606e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:37.154441 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f2a24af1-1b42-48a9-babb-2f1e906f606e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:37.165152 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2a24af1-1b42-48a9-babb-2f1e906f606e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:37.165679 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2a24af1-1b42-48a9-babb-2f1e906f606e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:37.166333 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2a24af1-1b42-48a9-babb-2f1e906f606e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:37.168177 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2a24af1-1b42-48a9-babb-2f1e906f606e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:37.169848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2a24af1-1b42-48a9-babb-2f1e906f606e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:37.170579 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2a24af1-1b42-48a9-babb-2f1e906f606e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:37.390042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9e635126-ec14-4ff4-8c72-624d6bc0ef1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.872025 Aug 24 16:39:37.397381 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 11/41] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:39:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:39:37.439012 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ec83416f-9a7c-4b35-98c2-801721d7aed0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:37.449707 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ec83416f-9a7c-4b35-98c2-801721d7aed0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:38.214851 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ec83416f-9a7c-4b35-98c2-801721d7aed0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:38.224401 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ec83416f-9a7c-4b35-98c2-801721d7aed0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1221 microversion: 2.1 time: 0.815774 Aug 24 16:39:38.228119 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f2a24af1-1b42-48a9-babb-2f1e906f606e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:38.235313 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 12/42] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:37 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1221 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:38.250568 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f2a24af1-1b42-48a9-babb-2f1e906f606e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1272 microversion: 2.1 time: 1.100808 Aug 24 16:39:38.251625 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:38.254527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:38.264718 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 31/43] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:37 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1272 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:38.277748 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:38.278777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:38.279666 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:38.280936 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:38.284074 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:38.284911 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:39.249985 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2a8003ad-15c5-4672-861c-ba061638b39c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:39.251059 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2a8003ad-15c5-4672-861c-ba061638b39c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:39.272612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a8003ad-15c5-4672-861c-ba061638b39c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:39.273276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a8003ad-15c5-4672-861c-ba061638b39c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:39.287399 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a8003ad-15c5-4672-861c-ba061638b39c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:39.298831 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a8003ad-15c5-4672-861c-ba061638b39c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:39.301431 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a8003ad-15c5-4672-861c-ba061638b39c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:39.303521 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a8003ad-15c5-4672-861c-ba061638b39c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:39.314493 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:39.345062 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:39.353198 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:39.360421 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-aff1896a-ae33-4011-846c-c3adec61e323 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1332 microversion: 2.20 time: 1.116242 Aug 24 16:39:39.382084 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 13/44] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:38 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1332 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:39.413372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4c0f56fb-06c0-4d8b-aebd-549fb5853d77 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:39.414227 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4c0f56fb-06c0-4d8b-aebd-549fb5853d77 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:39.423484 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4c0f56fb-06c0-4d8b-aebd-549fb5853d77 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:39.424231 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4c0f56fb-06c0-4d8b-aebd-549fb5853d77 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:39.425025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4c0f56fb-06c0-4d8b-aebd-549fb5853d77 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:39.426292 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4c0f56fb-06c0-4d8b-aebd-549fb5853d77 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:39.427071 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4c0f56fb-06c0-4d8b-aebd-549fb5853d77 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:39.427900 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4c0f56fb-06c0-4d8b-aebd-549fb5853d77 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:39.880589 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2a8003ad-15c5-4672-861c-ba061638b39c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:39.937124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2a8003ad-15c5-4672-861c-ba061638b39c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1217 microversion: 2.1 time: 0.670260 Aug 24 16:39:39.937984 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 32/45] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:39 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1217 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:40.397320 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:40.398180 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:40.410953 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:40.416035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:40.416903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:40.418837 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:40.419805 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:40.429050 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:40.931425 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4c0f56fb-06c0-4d8b-aebd-549fb5853d77 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:40.943024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4c0f56fb-06c0-4d8b-aebd-549fb5853d77 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 1.558651 Aug 24 16:39:40.943722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 14/46] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:39 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:40.971409 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8b445a8f-d559-4bda-b1be-1d9213f8f91b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:40.973944 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8b445a8f-d559-4bda-b1be-1d9213f8f91b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:40.997016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b445a8f-d559-4bda-b1be-1d9213f8f91b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:40.999620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b445a8f-d559-4bda-b1be-1d9213f8f91b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:41.003053 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b445a8f-d559-4bda-b1be-1d9213f8f91b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:41.012287 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b445a8f-d559-4bda-b1be-1d9213f8f91b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:41.015026 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b445a8f-d559-4bda-b1be-1d9213f8f91b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:41.018060 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b445a8f-d559-4bda-b1be-1d9213f8f91b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:41.321214 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:41.341120 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:41.350596 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:41.352839 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-42bcd94d-1d21-46e9-bf03-4f7d7c9957ec tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1338 microversion: 2.20 time: 0.960045 Aug 24 16:39:41.361218 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 33/47] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:40 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1338 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:41.761866 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8b445a8f-d559-4bda-b1be-1d9213f8f91b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:41.773950 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8b445a8f-d559-4bda-b1be-1d9213f8f91b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1279 microversion: 2.1 time: 0.811060 Aug 24 16:39:41.797783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 15/48] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:40 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1279 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:41.971503 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c57141c0-da56-4bcf-ac4f-99c9fcbe26aa tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:41.973657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c57141c0-da56-4bcf-ac4f-99c9fcbe26aa tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:42.001585 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c57141c0-da56-4bcf-ac4f-99c9fcbe26aa tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:42.002356 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c57141c0-da56-4bcf-ac4f-99c9fcbe26aa tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:42.002991 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c57141c0-da56-4bcf-ac4f-99c9fcbe26aa tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:42.004186 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c57141c0-da56-4bcf-ac4f-99c9fcbe26aa tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:42.005220 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c57141c0-da56-4bcf-ac4f-99c9fcbe26aa tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:42.007348 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c57141c0-da56-4bcf-ac4f-99c9fcbe26aa tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:42.382633 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:42.384725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:42.404316 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:42.408227 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:42.408962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:42.413265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:42.415992 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:42.419110 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:42.747918 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:42.771930 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:42.773675 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:42.774924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a5c61dc9-8342-404a-b621-ae4164fec97d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1338 microversion: 2.20 time: 0.398184 Aug 24 16:39:42.775677 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 16/49] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:42 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1338 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:42.814975 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-08c39794-7826-48c4-96fb-831d0378b289 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:42.815739 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-08c39794-7826-48c4-96fb-831d0378b289 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:42.847305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-08c39794-7826-48c4-96fb-831d0378b289 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:42.856351 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-08c39794-7826-48c4-96fb-831d0378b289 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:42.861013 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-08c39794-7826-48c4-96fb-831d0378b289 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:42.863228 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-08c39794-7826-48c4-96fb-831d0378b289 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:42.870133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-08c39794-7826-48c4-96fb-831d0378b289 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:42.875801 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-08c39794-7826-48c4-96fb-831d0378b289 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:43.448207 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:43.617235 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c57141c0-da56-4bcf-ac4f-99c9fcbe26aa tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:43.635425 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c57141c0-da56-4bcf-ac4f-99c9fcbe26aa tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 1.668673 Aug 24 16:39:43.650187 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 34/50] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:41 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:43.808077 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:43.811200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:43.825458 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:43.826013 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:43.830947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:43.838022 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:43.840923 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:43.843637 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:44.439691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-08c39794-7826-48c4-96fb-831d0378b289 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:44.457586 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-08c39794-7826-48c4-96fb-831d0378b289 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 1.650864 Aug 24 16:39:44.466982 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 17/51] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:42 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:44.664236 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f85cd2e6-ccbe-4e61-88fb-ab394c43b69e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:44.665380 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f85cd2e6-ccbe-4e61-88fb-ab394c43b69e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:44.681988 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f85cd2e6-ccbe-4e61-88fb-ab394c43b69e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:44.682831 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f85cd2e6-ccbe-4e61-88fb-ab394c43b69e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:44.683544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f85cd2e6-ccbe-4e61-88fb-ab394c43b69e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:44.684787 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f85cd2e6-ccbe-4e61-88fb-ab394c43b69e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:44.688787 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f85cd2e6-ccbe-4e61-88fb-ab394c43b69e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:44.689693 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f85cd2e6-ccbe-4e61-88fb-ab394c43b69e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:45.908304 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:45.917866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:45.935816 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:45.938200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6048e39f-381f-4859-b46d-1768b01b4199 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 2.141732 Aug 24 16:39:45.940555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 35/52] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:43 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:45.956378 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-23c2279f-4411-4094-a559-4647e35a738d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:45.957010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-23c2279f-4411-4094-a559-4647e35a738d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:45.982438 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23c2279f-4411-4094-a559-4647e35a738d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:45.982838 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23c2279f-4411-4094-a559-4647e35a738d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:45.983280 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23c2279f-4411-4094-a559-4647e35a738d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:45.988136 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23c2279f-4411-4094-a559-4647e35a738d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:45.989059 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23c2279f-4411-4094-a559-4647e35a738d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:45.990402 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23c2279f-4411-4094-a559-4647e35a738d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:46.582803 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=16 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:46.618496 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f85cd2e6-ccbe-4e61-88fb-ab394c43b69e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:46.636272 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f85cd2e6-ccbe-4e61-88fb-ab394c43b69e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 1.977420 Aug 24 16:39:46.660235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 18/53] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:44 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:46.853049 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-23c2279f-4411-4094-a559-4647e35a738d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:46.862120 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-23c2279f-4411-4094-a559-4647e35a738d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.920420 Aug 24 16:39:46.868574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 36/54] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:45 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:46.881785 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-5f8cd289-c515-4d57-ad65-ef9178a58570 req-0cf61c99-8208-4ba1-9830-e9ef8d51e06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aebb90c5-4e6c-4359-bc7f-f0d247ca9293", "tag": "efdbc14e-ee09-47f3-861d-ae7f753b3478"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:46.969099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:46.970037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=6 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:46.972058 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5f8cd289-c515-4d57-ad65-ef9178a58570 req-0cf61c99-8208-4ba1-9830-e9ef8d51e06d service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:46.972784 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5f8cd289-c515-4d57-ad65-ef9178a58570 req-0cf61c99-8208-4ba1-9830-e9ef8d51e06d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:46.973459 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5f8cd289-c515-4d57-ad65-ef9178a58570 req-0cf61c99-8208-4ba1-9830-e9ef8d51e06d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:46.992531 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-bf8438be-750e-4731-942b-03e810868813 req-b4469362-132d-42f2-a22d-1adb6ff9b742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66f46124-a6dc-4300-88a6-3143240719da", "tag": "f4013556-5bff-4eef-bfeb-7c2f27b64c4a"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:47.021941 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-5f8cd289-c515-4d57-ad65-ef9178a58570 req-0cf61c99-8208-4ba1-9830-e9ef8d51e06d service nova] Creating event network-changed:efdbc14e-ee09-47f3-861d-ae7f753b3478 for instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 on hv-cinder-77957 Aug 24 16:39:47.023037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5f8cd289-c515-4d57-ad65-ef9178a58570 req-0cf61c99-8208-4ba1-9830-e9ef8d51e06d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127165) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 16:39:47.023615 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5f8cd289-c515-4d57-ad65-ef9178a58570 req-0cf61c99-8208-4ba1-9830-e9ef8d51e06d service nova] Acquired lock "compute-rpcapi-router" {{(pid=127165) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 16:39:47.025106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-52a26d84-2e2d-4bdd-a224-dd6aae5d6736 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.026027 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-52a26d84-2e2d-4bdd-a224-dd6aae5d6736 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.027228 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-52a26d84-2e2d-4bdd-a224-dd6aae5d6736 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:47.028426 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-52a26d84-2e2d-4bdd-a224-dd6aae5d6736 None None] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.033236 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-bf8438be-750e-4731-942b-03e810868813 req-b4469362-132d-42f2-a22d-1adb6ff9b742 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.034093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-bf8438be-750e-4731-942b-03e810868813 req-b4469362-132d-42f2-a22d-1adb6ff9b742 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.040427 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-bf8438be-750e-4731-942b-03e810868813 req-b4469362-132d-42f2-a22d-1adb6ff9b742 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:47.042534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-52a26d84-2e2d-4bdd-a224-dd6aae5d6736 None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.043594 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-52a26d84-2e2d-4bdd-a224-dd6aae5d6736 None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:47.073322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.compute.rpcapi [None req-52a26d84-2e2d-4bdd-a224-dd6aae5d6736 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 16:39:47.075300 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-52a26d84-2e2d-4bdd-a224-dd6aae5d6736 None None] Releasing lock "compute-rpcapi-router" {{(pid=127165) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 16:39:47.121694 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-52a26d84-2e2d-4bdd-a224-dd6aae5d6736 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350788 Aug 24 16:39:47.124260 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 19/55] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:47.137093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-bf8438be-750e-4731-942b-03e810868813 req-b4469362-132d-42f2-a22d-1adb6ff9b742 service nova] Creating event network-changed:f4013556-5bff-4eef-bfeb-7c2f27b64c4a for instance 66f46124-a6dc-4300-88a6-3143240719da on hv-cinder-77957 Aug 24 16:39:47.139035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-bf8438be-750e-4731-942b-03e810868813 req-b4469362-132d-42f2-a22d-1adb6ff9b742 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127166) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 16:39:47.140275 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:47.140732 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-bf8438be-750e-4731-942b-03e810868813 req-b4469362-132d-42f2-a22d-1adb6ff9b742 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127166) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 16:39:47.141626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:47.144618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2f54b04-d907-4068-9b29-f04f52f05244 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.145233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2f54b04-d907-4068-9b29-f04f52f05244 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.148582 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2f54b04-d907-4068-9b29-f04f52f05244 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:47.149691 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2f54b04-d907-4068-9b29-f04f52f05244 None None] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.150412 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2f54b04-d907-4068-9b29-f04f52f05244 None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.150994 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2f54b04-d907-4068-9b29-f04f52f05244 None None] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:47.166230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.167130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.169098 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:47.170064 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.170672 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.171336 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:47.205372 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.compute.rpcapi [None req-d2f54b04-d907-4068-9b29-f04f52f05244 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 16:39:47.207323 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2f54b04-d907-4068-9b29-f04f52f05244 None None] Releasing lock "compute-rpcapi-router" {{(pid=127166) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 16:39:47.264673 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d2f54b04-d907-4068-9b29-f04f52f05244 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394144 Aug 24 16:39:47.265731 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 37/56] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:47.625587 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:47.654405 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:47.658517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:47.665354 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-45249980-910b-4f49-9413-95bb5122e406 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.538736 Aug 24 16:39:47.670772 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7820fb25-f3c8-427b-8148-76aed3f84797 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:47.671626 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-7820fb25-f3c8-427b-8148-76aed3f84797 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:47.681579 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 20/57] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:47 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:47.687700 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7820fb25-f3c8-427b-8148-76aed3f84797 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.691045 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7820fb25-f3c8-427b-8148-76aed3f84797 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.691504 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7820fb25-f3c8-427b-8148-76aed3f84797 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:47.693790 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7820fb25-f3c8-427b-8148-76aed3f84797 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.694299 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7820fb25-f3c8-427b-8148-76aed3f84797 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.694733 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7820fb25-f3c8-427b-8148-76aed3f84797 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:47.892574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f3862706-b74f-48d4-a4a3-03a3c983e9eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:47.895017 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f3862706-b74f-48d4-a4a3-03a3c983e9eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:47.912195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f3862706-b74f-48d4-a4a3-03a3c983e9eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.914534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f3862706-b74f-48d4-a4a3-03a3c983e9eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.915710 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f3862706-b74f-48d4-a4a3-03a3c983e9eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:47.921211 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f3862706-b74f-48d4-a4a3-03a3c983e9eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:47.922366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f3862706-b74f-48d4-a4a3-03a3c983e9eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:47.923040 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f3862706-b74f-48d4-a4a3-03a3c983e9eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:48.224422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=26 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:48.342665 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-7820fb25-f3c8-427b-8148-76aed3f84797 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:48.353108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7820fb25-f3c8-427b-8148-76aed3f84797 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.686969 Aug 24 16:39:48.370345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 38/58] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:47 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:48.697573 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:48.698662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:48.707500 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:48.709336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:48.710971 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:48.712278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:48.713140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:48.713817 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:48.804415 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f3862706-b74f-48d4-a4a3-03a3c983e9eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:48.830772 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f3862706-b74f-48d4-a4a3-03a3c983e9eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.943381 Aug 24 16:39:48.837506 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 21/59] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:47 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:49.376463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ee604e11-83bc-46b9-802b-e215b41f9138 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:49.377317 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ee604e11-83bc-46b9-802b-e215b41f9138 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:49.387924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee604e11-83bc-46b9-802b-e215b41f9138 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:49.390633 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee604e11-83bc-46b9-802b-e215b41f9138 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:49.391256 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee604e11-83bc-46b9-802b-e215b41f9138 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:49.397424 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee604e11-83bc-46b9-802b-e215b41f9138 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:49.398657 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee604e11-83bc-46b9-802b-e215b41f9138 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:49.402214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee604e11-83bc-46b9-802b-e215b41f9138 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:49.835344 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:49.858967 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:49.860632 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:49.882219 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ef7ba06f-f5e5-4f78-af90-c7f82975f7aa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 1.171833 Aug 24 16:39:49.883033 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 39/60] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:48 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:39:49.907309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8f85f00c-c188-454c-b903-974d199b92b1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:49.908164 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8f85f00c-c188-454c-b903-974d199b92b1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:49.917395 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8f85f00c-c188-454c-b903-974d199b92b1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:49.918111 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8f85f00c-c188-454c-b903-974d199b92b1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:49.919149 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8f85f00c-c188-454c-b903-974d199b92b1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:49.920050 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8f85f00c-c188-454c-b903-974d199b92b1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:49.920969 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8f85f00c-c188-454c-b903-974d199b92b1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:49.921562 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8f85f00c-c188-454c-b903-974d199b92b1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:50.297174 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ee604e11-83bc-46b9-802b-e215b41f9138 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:50.308190 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ee604e11-83bc-46b9-802b-e215b41f9138 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.935646 Aug 24 16:39:50.319230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 22/61] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:49 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:50.339505 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-5b4ea1e4-cc1c-4e5c-9ed6-81c3f145e609 req-e0d5c7b8-9fb6-4b16-bf25-5468c0876275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efbd14e1-e123-4de5-a3a8-a05a401ee2fe", "tag": "10c3fbc7-c8f0-4c14-8a5c-d7edc10d3544"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:50.391747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5b4ea1e4-cc1c-4e5c-9ed6-81c3f145e609 req-e0d5c7b8-9fb6-4b16-bf25-5468c0876275 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:50.398772 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5b4ea1e4-cc1c-4e5c-9ed6-81c3f145e609 req-e0d5c7b8-9fb6-4b16-bf25-5468c0876275 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:50.401397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5b4ea1e4-cc1c-4e5c-9ed6-81c3f145e609 req-e0d5c7b8-9fb6-4b16-bf25-5468c0876275 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:50.455609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-5b4ea1e4-cc1c-4e5c-9ed6-81c3f145e609 req-e0d5c7b8-9fb6-4b16-bf25-5468c0876275 service nova] Creating event network-changed:10c3fbc7-c8f0-4c14-8a5c-d7edc10d3544 for instance efbd14e1-e123-4de5-a3a8-a05a401ee2fe on hv-cinder-77957 Aug 24 16:39:50.470333 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-5b4ea1e4-cc1c-4e5c-9ed6-81c3f145e609 req-e0d5c7b8-9fb6-4b16-bf25-5468c0876275 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148217 Aug 24 16:39:50.473229 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 23/62] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:50.622399 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-1612b60b-6aef-4577-8d07-bf154962956f req-c8bb7646-b0a5-4cc6-8f09-7ad4bf19837a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad10931-9764-4362-a3b6-c5cd27974783", "tag": "8b8924d9-3ab9-4080-8066-5dffb8805604"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:39:50.636329 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-1612b60b-6aef-4577-8d07-bf154962956f req-c8bb7646-b0a5-4cc6-8f09-7ad4bf19837a service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:50.636815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-1612b60b-6aef-4577-8d07-bf154962956f req-c8bb7646-b0a5-4cc6-8f09-7ad4bf19837a service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:50.637245 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-1612b60b-6aef-4577-8d07-bf154962956f req-c8bb7646-b0a5-4cc6-8f09-7ad4bf19837a service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:50.676129 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-1612b60b-6aef-4577-8d07-bf154962956f req-c8bb7646-b0a5-4cc6-8f09-7ad4bf19837a service nova] Creating event network-changed:8b8924d9-3ab9-4080-8066-5dffb8805604 for instance 1ad10931-9764-4362-a3b6-c5cd27974783 on hv-cinder-77957 Aug 24 16:39:50.687422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-1612b60b-6aef-4577-8d07-bf154962956f req-c8bb7646-b0a5-4cc6-8f09-7ad4bf19837a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067762 Aug 24 16:39:50.690269 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 24/63] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:39:50.794849 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8f85f00c-c188-454c-b903-974d199b92b1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:50.803838 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8f85f00c-c188-454c-b903-974d199b92b1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.903553 Aug 24 16:39:50.817316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 40/64] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:49 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:50.909979 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:50.912624 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:50.919099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:50.919837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:50.920410 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:50.921515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:50.922382 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:50.923190 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:51.343878 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-87cfd423-2a26-48e5-a6db-5eacdc4abe66 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:51.344883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-87cfd423-2a26-48e5-a6db-5eacdc4abe66 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:51.351226 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-87cfd423-2a26-48e5-a6db-5eacdc4abe66 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:51.352202 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-87cfd423-2a26-48e5-a6db-5eacdc4abe66 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:51.352828 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-87cfd423-2a26-48e5-a6db-5eacdc4abe66 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:51.354257 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-87cfd423-2a26-48e5-a6db-5eacdc4abe66 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:51.354871 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-87cfd423-2a26-48e5-a6db-5eacdc4abe66 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:51.355612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-87cfd423-2a26-48e5-a6db-5eacdc4abe66 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:51.531345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:51.542769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:51.547035 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:51.548934 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-91e97859-3e65-4c5c-b6ed-97dd70eaeba2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.643630 Aug 24 16:39:51.552615 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 25/65] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:50 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:51.741142 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-87cfd423-2a26-48e5-a6db-5eacdc4abe66 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:51.752922 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-87cfd423-2a26-48e5-a6db-5eacdc4abe66 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.412324 Aug 24 16:39:51.757882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 41/66] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:51 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:51.826280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-be1dfd37-70dd-4083-80b8-1239d73d2731 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:51.827173 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-be1dfd37-70dd-4083-80b8-1239d73d2731 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:51.843913 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-be1dfd37-70dd-4083-80b8-1239d73d2731 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:51.844205 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-be1dfd37-70dd-4083-80b8-1239d73d2731 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:51.849926 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-be1dfd37-70dd-4083-80b8-1239d73d2731 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:51.850697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-be1dfd37-70dd-4083-80b8-1239d73d2731 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:51.851265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-be1dfd37-70dd-4083-80b8-1239d73d2731 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:51.852140 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-be1dfd37-70dd-4083-80b8-1239d73d2731 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:52.204437 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-be1dfd37-70dd-4083-80b8-1239d73d2731 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:52.217788 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-be1dfd37-70dd-4083-80b8-1239d73d2731 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.395779 Aug 24 16:39:52.218865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 26/67] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:51 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:52.577266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:52.578144 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:52.590470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:52.590932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:52.591378 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:52.592756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:52.593219 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:52.593654 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:52.765548 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:52.775057 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8b60dc2a-10a1-4677-b496-2489746420f7 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:52.776534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8b60dc2a-10a1-4677-b496-2489746420f7 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:52.780595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:52.782364 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:52.784193 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2a-10a1-4677-b496-2489746420f7 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:52.784466 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-42547255-e974-4802-bd01-214f00be4ff6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.210897 Aug 24 16:39:52.784685 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2a-10a1-4677-b496-2489746420f7 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:52.785128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2a-10a1-4677-b496-2489746420f7 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:52.785865 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 42/68] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:52 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:52.792906 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2a-10a1-4677-b496-2489746420f7 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:52.794354 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2a-10a1-4677-b496-2489746420f7 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:52.794794 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8b60dc2a-10a1-4677-b496-2489746420f7 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:53.197401 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8b60dc2a-10a1-4677-b496-2489746420f7 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:53.219378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8b60dc2a-10a1-4677-b496-2489746420f7 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.449087 Aug 24 16:39:53.231984 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 27/69] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:52 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:53.242764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-bbe2d798-6703-4583-8dde-10c65eb898ce tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:53.243358 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-bbe2d798-6703-4583-8dde-10c65eb898ce tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:53.259015 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbe2d798-6703-4583-8dde-10c65eb898ce tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:53.259521 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbe2d798-6703-4583-8dde-10c65eb898ce tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:53.259976 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbe2d798-6703-4583-8dde-10c65eb898ce tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:53.260786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbe2d798-6703-4583-8dde-10c65eb898ce tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:53.261249 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbe2d798-6703-4583-8dde-10c65eb898ce tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:53.261680 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbe2d798-6703-4583-8dde-10c65eb898ce tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:53.456198 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-bbe2d798-6703-4583-8dde-10c65eb898ce tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:53.468687 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-bbe2d798-6703-4583-8dde-10c65eb898ce tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.229680 Aug 24 16:39:53.472992 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 43/70] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:53 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:53.810030 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:53.810724 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:53.817035 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:53.818252 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:53.818754 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:53.819514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:53.820063 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:53.820569 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:53.824969 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=100 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:53.985991 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:53.995043 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:53.996416 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:53.997631 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-5c63acc2-a00d-4f5d-9998-1431ac589a54 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.193644 Aug 24 16:39:53.998188 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 28/71] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:53 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:54.242808 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3479b6de-bca0-4edf-86bd-b80b07eb7a37 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:54.243430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3479b6de-bca0-4edf-86bd-b80b07eb7a37 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:54.250782 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3479b6de-bca0-4edf-86bd-b80b07eb7a37 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:54.251276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3479b6de-bca0-4edf-86bd-b80b07eb7a37 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:54.251716 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3479b6de-bca0-4edf-86bd-b80b07eb7a37 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:54.252483 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3479b6de-bca0-4edf-86bd-b80b07eb7a37 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:54.252928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3479b6de-bca0-4edf-86bd-b80b07eb7a37 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:54.253372 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3479b6de-bca0-4edf-86bd-b80b07eb7a37 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:54.412233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-3479b6de-bca0-4edf-86bd-b80b07eb7a37 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:54.424851 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3479b6de-bca0-4edf-86bd-b80b07eb7a37 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.187317 Aug 24 16:39:54.425942 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 44/72] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:54 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:54.491204 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-18a210b1-d333-427c-abf7-95d4da1c5090 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:54.493107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-18a210b1-d333-427c-abf7-95d4da1c5090 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:54.502935 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-18a210b1-d333-427c-abf7-95d4da1c5090 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:54.503568 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-18a210b1-d333-427c-abf7-95d4da1c5090 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:54.504156 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-18a210b1-d333-427c-abf7-95d4da1c5090 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:54.505141 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-18a210b1-d333-427c-abf7-95d4da1c5090 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:54.505957 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-18a210b1-d333-427c-abf7-95d4da1c5090 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:54.506563 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-18a210b1-d333-427c-abf7-95d4da1c5090 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:54.667027 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-18a210b1-d333-427c-abf7-95d4da1c5090 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:54.680834 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-18a210b1-d333-427c-abf7-95d4da1c5090 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.194557 Aug 24 16:39:54.695151 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 29/73] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:54 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:39:55.025716 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:55.026344 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:55.037443 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:55.050426 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:55.050426 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:55.050426 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:55.050426 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:55.050895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:55.051390 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:55.060178 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=97 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:55.244946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:55.256158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:55.257672 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:55.259611 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-263d7bd0-22a5-4714-adfc-1df475b6516a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.238956 Aug 24 16:39:55.260438 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 45/74] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:55 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:55.451880 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a0c2155e-9502-4686-a407-5505c7773c40 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:55.452422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a0c2155e-9502-4686-a407-5505c7773c40 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:55.465341 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a0c2155e-9502-4686-a407-5505c7773c40 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:55.466104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a0c2155e-9502-4686-a407-5505c7773c40 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:55.466832 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a0c2155e-9502-4686-a407-5505c7773c40 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:55.467696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a0c2155e-9502-4686-a407-5505c7773c40 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:55.468371 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a0c2155e-9502-4686-a407-5505c7773c40 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:55.469162 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a0c2155e-9502-4686-a407-5505c7773c40 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:55.616012 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a0c2155e-9502-4686-a407-5505c7773c40 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:55.628452 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a0c2155e-9502-4686-a407-5505c7773c40 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.185922 Aug 24 16:39:55.629861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 30/75] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:55 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:55.703338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0406135f-a239-41e5-8e71-2a443b594a77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:55.704049 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0406135f-a239-41e5-8e71-2a443b594a77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:55.711200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0406135f-a239-41e5-8e71-2a443b594a77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:55.712063 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0406135f-a239-41e5-8e71-2a443b594a77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:55.712711 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0406135f-a239-41e5-8e71-2a443b594a77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:55.713659 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0406135f-a239-41e5-8e71-2a443b594a77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:55.714294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0406135f-a239-41e5-8e71-2a443b594a77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:55.714905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0406135f-a239-41e5-8e71-2a443b594a77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:55.879842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0406135f-a239-41e5-8e71-2a443b594a77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:55.889906 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0406135f-a239-41e5-8e71-2a443b594a77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.191551 Aug 24 16:39:55.890501 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 46/76] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:55 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:56.284015 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:56.285035 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:56.295467 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:56.296472 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:56.297790 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:56.298857 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:56.299558 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:56.300253 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:56.489618 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:56.501167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:56.502858 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:56.504606 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8ae7ebae-4bbf-48b6-be58-52a05363a24e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.225440 Aug 24 16:39:56.505256 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 31/77] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:56 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:56.652302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a996004b-a694-4e6a-bec8-7d15532be667 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:56.653234 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a996004b-a694-4e6a-bec8-7d15532be667 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:56.660310 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a996004b-a694-4e6a-bec8-7d15532be667 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:56.660801 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a996004b-a694-4e6a-bec8-7d15532be667 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:56.661924 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a996004b-a694-4e6a-bec8-7d15532be667 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:56.662858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a996004b-a694-4e6a-bec8-7d15532be667 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:56.663492 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a996004b-a694-4e6a-bec8-7d15532be667 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:56.663928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a996004b-a694-4e6a-bec8-7d15532be667 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:56.821966 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a996004b-a694-4e6a-bec8-7d15532be667 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:56.832441 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a996004b-a694-4e6a-bec8-7d15532be667 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.184868 Aug 24 16:39:56.833622 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 47/78] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:56 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:56.911430 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-00f35d0a-2e75-472c-b077-e845e7246c0e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:56.912974 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-00f35d0a-2e75-472c-b077-e845e7246c0e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:56.919540 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-00f35d0a-2e75-472c-b077-e845e7246c0e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:56.920066 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-00f35d0a-2e75-472c-b077-e845e7246c0e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:56.920514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-00f35d0a-2e75-472c-b077-e845e7246c0e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:56.921220 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-00f35d0a-2e75-472c-b077-e845e7246c0e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:56.921677 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-00f35d0a-2e75-472c-b077-e845e7246c0e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:56.922103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-00f35d0a-2e75-472c-b077-e845e7246c0e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:57.071015 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:57.075255 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-00f35d0a-2e75-472c-b077-e845e7246c0e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:57.084344 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-00f35d0a-2e75-472c-b077-e845e7246c0e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.176777 Aug 24 16:39:57.085095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 32/79] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:56 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:57.532479 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:57.533404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:57.537928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:57.542640 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:57.543597 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:57.544688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:57.545617 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:57.546885 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:57.547619 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:57.722797 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:57.732770 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:57.734284 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:57.735610 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f45e5fc9-8dc3-41ac-b967-ee808bb9f129 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.211951 Aug 24 16:39:57.736228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 48/80] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:57 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:57.857434 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ae2d74a8-6488-441d-9de7-ad2f2152f6bf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:57.858098 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ae2d74a8-6488-441d-9de7-ad2f2152f6bf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:57.866600 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ae2d74a8-6488-441d-9de7-ad2f2152f6bf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:57.867122 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ae2d74a8-6488-441d-9de7-ad2f2152f6bf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:57.872326 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ae2d74a8-6488-441d-9de7-ad2f2152f6bf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:57.873074 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ae2d74a8-6488-441d-9de7-ad2f2152f6bf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:57.873547 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ae2d74a8-6488-441d-9de7-ad2f2152f6bf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:57.873984 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ae2d74a8-6488-441d-9de7-ad2f2152f6bf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:58.054758 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ae2d74a8-6488-441d-9de7-ad2f2152f6bf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:58.062375 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ae2d74a8-6488-441d-9de7-ad2f2152f6bf tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.208832 Aug 24 16:39:58.062944 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 33/81] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:57 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:58.106289 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-139acb64-1469-438f-9b2c-65e1de073d26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:58.107005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-139acb64-1469-438f-9b2c-65e1de073d26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:58.113181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-139acb64-1469-438f-9b2c-65e1de073d26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:58.113753 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-139acb64-1469-438f-9b2c-65e1de073d26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:58.115086 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-139acb64-1469-438f-9b2c-65e1de073d26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:58.116051 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-139acb64-1469-438f-9b2c-65e1de073d26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:58.116645 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-139acb64-1469-438f-9b2c-65e1de073d26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:58.117138 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-139acb64-1469-438f-9b2c-65e1de073d26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:58.438834 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-139acb64-1469-438f-9b2c-65e1de073d26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:58.449574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-139acb64-1469-438f-9b2c-65e1de073d26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.347651 Aug 24 16:39:58.450435 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 49/82] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:58 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:58.771366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:58.772066 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:58.805436 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:58.805436 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:58.805436 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:58.805436 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:58.805953 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:58.805953 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:59.030492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:59.042043 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:59.048105 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:59.050448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e35f113a-ca14-4423-91c1-4394d073b96f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.285132 Aug 24 16:39:59.052158 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 34/83] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:39:58 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:39:59.084221 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9990eb8b-b22f-44c3-a85c-6be3bdb111a5 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:59.085551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9990eb8b-b22f-44c3-a85c-6be3bdb111a5 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:59.092843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9990eb8b-b22f-44c3-a85c-6be3bdb111a5 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:59.093516 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9990eb8b-b22f-44c3-a85c-6be3bdb111a5 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:59.094139 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9990eb8b-b22f-44c3-a85c-6be3bdb111a5 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:59.095305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9990eb8b-b22f-44c3-a85c-6be3bdb111a5 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:59.095972 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9990eb8b-b22f-44c3-a85c-6be3bdb111a5 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:59.096629 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9990eb8b-b22f-44c3-a85c-6be3bdb111a5 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:59.283141 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9990eb8b-b22f-44c3-a85c-6be3bdb111a5 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:59.295040 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9990eb8b-b22f-44c3-a85c-6be3bdb111a5 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.215607 Aug 24 16:39:59.316303 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 50/84] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:59 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:39:59.470292 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ea2de8ce-18da-4f57-8f55-2ecabc5891b8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:39:59.470918 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ea2de8ce-18da-4f57-8f55-2ecabc5891b8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:39:59.479221 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea2de8ce-18da-4f57-8f55-2ecabc5891b8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:59.480017 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea2de8ce-18da-4f57-8f55-2ecabc5891b8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:59.480380 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea2de8ce-18da-4f57-8f55-2ecabc5891b8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:59.481345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea2de8ce-18da-4f57-8f55-2ecabc5891b8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:39:59.481816 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea2de8ce-18da-4f57-8f55-2ecabc5891b8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:39:59.482246 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea2de8ce-18da-4f57-8f55-2ecabc5891b8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:39:59.659912 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ea2de8ce-18da-4f57-8f55-2ecabc5891b8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:39:59.670858 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ea2de8ce-18da-4f57-8f55-2ecabc5891b8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.204699 Aug 24 16:39:59.671737 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 35/85] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:39:59 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:00.073719 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:00.074410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:00.080848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:00.081425 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:00.081954 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:00.082874 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:00.084604 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:00.085144 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:00.244727 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:00.257520 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:00.258720 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:00.261851 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a6e04668-1576-4405-9846-59cd5e4e88a7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.191828 Aug 24 16:40:00.263216 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 51/86] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:00 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:40:00.319060 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f691ef15-5cb1-46b6-b47b-0fac0beb2f82 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:00.320356 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f691ef15-5cb1-46b6-b47b-0fac0beb2f82 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:00.328552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f691ef15-5cb1-46b6-b47b-0fac0beb2f82 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:00.329210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f691ef15-5cb1-46b6-b47b-0fac0beb2f82 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:00.329799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f691ef15-5cb1-46b6-b47b-0fac0beb2f82 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:00.330504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f691ef15-5cb1-46b6-b47b-0fac0beb2f82 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:00.330959 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f691ef15-5cb1-46b6-b47b-0fac0beb2f82 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:00.331388 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f691ef15-5cb1-46b6-b47b-0fac0beb2f82 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:00.530670 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f691ef15-5cb1-46b6-b47b-0fac0beb2f82 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:00.543748 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f691ef15-5cb1-46b6-b47b-0fac0beb2f82 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.229990 Aug 24 16:40:00.544872 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 36/87] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:00 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:00.694115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5b399d25-0e19-41d5-a800-f40c6ab5e83a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:00.694939 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5b399d25-0e19-41d5-a800-f40c6ab5e83a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:00.701867 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b399d25-0e19-41d5-a800-f40c6ab5e83a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:00.702525 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b399d25-0e19-41d5-a800-f40c6ab5e83a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:00.703121 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b399d25-0e19-41d5-a800-f40c6ab5e83a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:00.704366 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b399d25-0e19-41d5-a800-f40c6ab5e83a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:00.705190 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b399d25-0e19-41d5-a800-f40c6ab5e83a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:00.705621 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b399d25-0e19-41d5-a800-f40c6ab5e83a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:00.850624 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5b399d25-0e19-41d5-a800-f40c6ab5e83a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:00.858786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5b399d25-0e19-41d5-a800-f40c6ab5e83a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.170178 Aug 24 16:40:00.859375 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 52/88] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:00 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:01.285464 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:01.286423 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:01.292433 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:01.293333 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:01.293974 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:01.294875 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:01.295389 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:01.296153 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:01.444530 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:01.454084 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:01.456156 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:01.457435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-def607cc-4fb8-4718-b7ef-5693874ec9ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.175780 Aug 24 16:40:01.458014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 37/89] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:01 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:40:01.564528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-decddaf6-4686-4cd5-b401-a44c22b024cc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:01.565144 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-decddaf6-4686-4cd5-b401-a44c22b024cc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:01.575178 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-decddaf6-4686-4cd5-b401-a44c22b024cc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:01.575667 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-decddaf6-4686-4cd5-b401-a44c22b024cc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:01.576130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-decddaf6-4686-4cd5-b401-a44c22b024cc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:01.576833 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-decddaf6-4686-4cd5-b401-a44c22b024cc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:01.577285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-decddaf6-4686-4cd5-b401-a44c22b024cc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:01.577707 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-decddaf6-4686-4cd5-b401-a44c22b024cc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:01.740555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-decddaf6-4686-4cd5-b401-a44c22b024cc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:01.749518 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-decddaf6-4686-4cd5-b401-a44c22b024cc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.188616 Aug 24 16:40:01.750131 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 53/90] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:01 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:01.879708 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ce4b488f-3e1d-4e8f-a581-1d65bbc3ba1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:01.881058 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ce4b488f-3e1d-4e8f-a581-1d65bbc3ba1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:01.886824 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ce4b488f-3e1d-4e8f-a581-1d65bbc3ba1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:01.887440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ce4b488f-3e1d-4e8f-a581-1d65bbc3ba1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:01.887823 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ce4b488f-3e1d-4e8f-a581-1d65bbc3ba1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:01.888741 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ce4b488f-3e1d-4e8f-a581-1d65bbc3ba1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:01.889194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ce4b488f-3e1d-4e8f-a581-1d65bbc3ba1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:01.889786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ce4b488f-3e1d-4e8f-a581-1d65bbc3ba1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:02.047623 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ce4b488f-3e1d-4e8f-a581-1d65bbc3ba1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:02.057921 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ce4b488f-3e1d-4e8f-a581-1d65bbc3ba1f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.182076 Aug 24 16:40:02.058642 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 38/91] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:01 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:02.490644 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:02.491388 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:02.505483 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:02.505483 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:02.505483 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:02.513680 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:02.515704 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:02.516184 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:02.774588 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-aa32c44e-7790-49a4-b61a-81e36a19a00a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:02.775824 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-aa32c44e-7790-49a4-b61a-81e36a19a00a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:02.789379 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa32c44e-7790-49a4-b61a-81e36a19a00a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:02.790135 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa32c44e-7790-49a4-b61a-81e36a19a00a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:02.790778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa32c44e-7790-49a4-b61a-81e36a19a00a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:02.793174 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa32c44e-7790-49a4-b61a-81e36a19a00a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:02.793875 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa32c44e-7790-49a4-b61a-81e36a19a00a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:02.795255 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa32c44e-7790-49a4-b61a-81e36a19a00a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:02.969592 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:02.983307 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:02.988737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:02.990831 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-15e7c946-d371-4b27-a52a-3d544f412dfd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.507798 Aug 24 16:40:02.994190 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 54/92] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:02 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:40:03.117816 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-aa32c44e-7790-49a4-b61a-81e36a19a00a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:03.126441 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-aa32c44e-7790-49a4-b61a-81e36a19a00a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.357174 Aug 24 16:40:03.127046 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 39/93] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:02 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:03.137942 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b1d73c3a-d39d-41bb-b102-5495fa666794 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:03.139584 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b1d73c3a-d39d-41bb-b102-5495fa666794 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:03.149148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b1d73c3a-d39d-41bb-b102-5495fa666794 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:03.149645 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b1d73c3a-d39d-41bb-b102-5495fa666794 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:03.150101 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b1d73c3a-d39d-41bb-b102-5495fa666794 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:03.150791 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b1d73c3a-d39d-41bb-b102-5495fa666794 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:03.152501 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b1d73c3a-d39d-41bb-b102-5495fa666794 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:03.153097 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b1d73c3a-d39d-41bb-b102-5495fa666794 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:03.231992 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-27381f2a-ed0b-4b29-a8e8-6277aab34574 req-01b7a5b6-1d10-42d5-9c22-4061739f5650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebb90c5-4e6c-4359-bc7f-f0d247ca9293", "name": "network-vif-plugged", "status": "completed", "tag": "efdbc14e-ee09-47f3-861d-ae7f753b3478"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:03.243232 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-27381f2a-ed0b-4b29-a8e8-6277aab34574 req-01b7a5b6-1d10-42d5-9c22-4061739f5650 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:03.243764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-27381f2a-ed0b-4b29-a8e8-6277aab34574 req-01b7a5b6-1d10-42d5-9c22-4061739f5650 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:03.244386 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-27381f2a-ed0b-4b29-a8e8-6277aab34574 req-01b7a5b6-1d10-42d5-9c22-4061739f5650 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:03.260377 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-27381f2a-ed0b-4b29-a8e8-6277aab34574 req-01b7a5b6-1d10-42d5-9c22-4061739f5650 service nova] Creating event network-vif-plugged:efdbc14e-ee09-47f3-861d-ae7f753b3478 for instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 on hv-cinder-77957 Aug 24 16:40:03.272561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-27381f2a-ed0b-4b29-a8e8-6277aab34574 req-01b7a5b6-1d10-42d5-9c22-4061739f5650 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276566 Aug 24 16:40:03.275800 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 55/94] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:03.351747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b1d73c3a-d39d-41bb-b102-5495fa666794 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:03.361653 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b1d73c3a-d39d-41bb-b102-5495fa666794 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.229695 Aug 24 16:40:03.362576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 40/95] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:03 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:04.018253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:04.018957 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:04.026945 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:04.034139 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:04.034954 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:04.037474 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:04.037970 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:04.038404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:04.154999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-01ab83ec-649e-4e4b-a91b-27a7c64cf028 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:04.155826 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-01ab83ec-649e-4e4b-a91b-27a7c64cf028 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:04.165990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-01ab83ec-649e-4e4b-a91b-27a7c64cf028 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:04.167397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-01ab83ec-649e-4e4b-a91b-27a7c64cf028 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:04.168909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-01ab83ec-649e-4e4b-a91b-27a7c64cf028 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:04.169806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-01ab83ec-649e-4e4b-a91b-27a7c64cf028 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:04.170361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-01ab83ec-649e-4e4b-a91b-27a7c64cf028 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:04.171057 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-01ab83ec-649e-4e4b-a91b-27a7c64cf028 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:04.556793 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:04.572031 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:04.576136 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:04.581324 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-4146236c-ad17-46af-b31c-66f20468ac24 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.565923 Aug 24 16:40:04.583931 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 56/96] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:04 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:40:04.596302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5b0b31d8-adf5-47b3-9eaa-eaa3575a7389 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:04.600009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5b0b31d8-adf5-47b3-9eaa-eaa3575a7389 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:04.605866 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-01ab83ec-649e-4e4b-a91b-27a7c64cf028 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:04.609874 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b0b31d8-adf5-47b3-9eaa-eaa3575a7389 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:04.610735 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b0b31d8-adf5-47b3-9eaa-eaa3575a7389 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:04.611336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b0b31d8-adf5-47b3-9eaa-eaa3575a7389 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:04.612573 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b0b31d8-adf5-47b3-9eaa-eaa3575a7389 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:04.613339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b0b31d8-adf5-47b3-9eaa-eaa3575a7389 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:04.615313 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b0b31d8-adf5-47b3-9eaa-eaa3575a7389 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:04.619445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-01ab83ec-649e-4e4b-a91b-27a7c64cf028 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.472831 Aug 24 16:40:04.638739 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 41/97] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:04 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:04.903821 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5b0b31d8-adf5-47b3-9eaa-eaa3575a7389 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:04.915404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5b0b31d8-adf5-47b3-9eaa-eaa3575a7389 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.330173 Aug 24 16:40:04.916866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 57/98] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:04 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:05.297858 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-6b321bb4-2885-44f2-9072-04a93ba69c14 req-68b12b2d-8577-48ef-a809-4e9da717a181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f46124-a6dc-4300-88a6-3143240719da", "name": "network-vif-plugged", "status": "completed", "tag": "f4013556-5bff-4eef-bfeb-7c2f27b64c4a"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:05.308039 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6b321bb4-2885-44f2-9072-04a93ba69c14 req-68b12b2d-8577-48ef-a809-4e9da717a181 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:05.308663 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6b321bb4-2885-44f2-9072-04a93ba69c14 req-68b12b2d-8577-48ef-a809-4e9da717a181 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:05.309102 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6b321bb4-2885-44f2-9072-04a93ba69c14 req-68b12b2d-8577-48ef-a809-4e9da717a181 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:05.324264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-6b321bb4-2885-44f2-9072-04a93ba69c14 req-68b12b2d-8577-48ef-a809-4e9da717a181 service nova] Creating event network-vif-plugged:f4013556-5bff-4eef-bfeb-7c2f27b64c4a for instance 66f46124-a6dc-4300-88a6-3143240719da on hv-cinder-77957 Aug 24 16:40:05.330567 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-6b321bb4-2885-44f2-9072-04a93ba69c14 req-68b12b2d-8577-48ef-a809-4e9da717a181 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035919 Aug 24 16:40:05.331918 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 42/99] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:05.608996 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:05.609656 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:05.620723 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:05.621230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:05.621685 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:05.622533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:05.623132 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:05.623698 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:05.649811 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-502032c9-a425-4a61-8a89-ad81863c0ac0 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:05.650827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-502032c9-a425-4a61-8a89-ad81863c0ac0 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:05.660319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-502032c9-a425-4a61-8a89-ad81863c0ac0 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:05.661587 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-502032c9-a425-4a61-8a89-ad81863c0ac0 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:05.662103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-502032c9-a425-4a61-8a89-ad81863c0ac0 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:05.663058 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-502032c9-a425-4a61-8a89-ad81863c0ac0 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:05.663597 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-502032c9-a425-4a61-8a89-ad81863c0ac0 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:05.664491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-502032c9-a425-4a61-8a89-ad81863c0ac0 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:05.825653 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:05.835035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:05.836236 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:05.837511 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-dd495bc9-818e-47c8-9c6f-2ed42e43b823 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.234504 Aug 24 16:40:05.838229 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 58/100] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:05 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:40:05.865651 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-502032c9-a425-4a61-8a89-ad81863c0ac0 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:05.875100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-502032c9-a425-4a61-8a89-ad81863c0ac0 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.232176 Aug 24 16:40:05.876019 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 43/101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:05 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:05.937764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3cb1dfa7-382c-434a-b114-57bc3c612b60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:05.938390 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3cb1dfa7-382c-434a-b114-57bc3c612b60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:05.945916 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3cb1dfa7-382c-434a-b114-57bc3c612b60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:05.946406 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3cb1dfa7-382c-434a-b114-57bc3c612b60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:05.946837 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3cb1dfa7-382c-434a-b114-57bc3c612b60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:05.947528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3cb1dfa7-382c-434a-b114-57bc3c612b60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:05.947995 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3cb1dfa7-382c-434a-b114-57bc3c612b60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:05.948662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3cb1dfa7-382c-434a-b114-57bc3c612b60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:06.102553 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-3cb1dfa7-382c-434a-b114-57bc3c612b60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:06.110917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3cb1dfa7-382c-434a-b114-57bc3c612b60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.176963 Aug 24 16:40:06.111499 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 59/102] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:05 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:06.866476 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:06.867085 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:06.873056 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:06.873538 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:06.873971 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:06.874654 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:06.875107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:06.875529 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:06.897314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6766925e-eaf7-4ce2-ba87-149db1c8942f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:06.897852 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6766925e-eaf7-4ce2-ba87-149db1c8942f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:06.904437 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6766925e-eaf7-4ce2-ba87-149db1c8942f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:06.904922 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6766925e-eaf7-4ce2-ba87-149db1c8942f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:06.905357 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6766925e-eaf7-4ce2-ba87-149db1c8942f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:06.906044 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6766925e-eaf7-4ce2-ba87-149db1c8942f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:06.906642 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6766925e-eaf7-4ce2-ba87-149db1c8942f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:06.907069 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6766925e-eaf7-4ce2-ba87-149db1c8942f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:07.081336 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:07.085928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6766925e-eaf7-4ce2-ba87-149db1c8942f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:07.090265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:07.091770 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:07.092894 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b87c60bf-b377-4602-a972-1cef683647ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.231050 Aug 24 16:40:07.093443 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 44/103] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:06 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:40:07.093568 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6766925e-eaf7-4ce2-ba87-149db1c8942f tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.200934 Aug 24 16:40:07.094137 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 60/104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:06 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:07.133065 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-3174bd78-e5d5-4ab1-9528-a1189257e768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:07.133756 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-3174bd78-e5d5-4ab1-9528-a1189257e768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:07.139533 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3174bd78-e5d5-4ab1-9528-a1189257e768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:07.140045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3174bd78-e5d5-4ab1-9528-a1189257e768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:07.140481 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3174bd78-e5d5-4ab1-9528-a1189257e768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:07.141165 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3174bd78-e5d5-4ab1-9528-a1189257e768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:07.141621 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3174bd78-e5d5-4ab1-9528-a1189257e768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:07.142042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3174bd78-e5d5-4ab1-9528-a1189257e768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:07.161914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=100 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:07.275728 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-3174bd78-e5d5-4ab1-9528-a1189257e768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:07.283544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-3174bd78-e5d5-4ab1-9528-a1189257e768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.154639 Aug 24 16:40:07.284152 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 45/105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:07 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:08.117428 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:08.118474 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3b748577-9137-4514-8636-2b2868b83e91 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:08.119199 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3b748577-9137-4514-8636-2b2868b83e91 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:08.119544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:08.127985 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3b748577-9137-4514-8636-2b2868b83e91 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:08.128983 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:08.129304 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3b748577-9137-4514-8636-2b2868b83e91 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:08.130597 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:08.130932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3b748577-9137-4514-8636-2b2868b83e91 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:08.131146 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:08.132033 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:08.132375 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3b748577-9137-4514-8636-2b2868b83e91 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:08.132662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:08.133151 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:08.133785 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3b748577-9137-4514-8636-2b2868b83e91 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:08.134462 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3b748577-9137-4514-8636-2b2868b83e91 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:08.396345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-3b748577-9137-4514-8636-2b2868b83e91 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:08.400061 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:08.405467 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3b748577-9137-4514-8636-2b2868b83e91 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.292724 Aug 24 16:40:08.408138 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 61/106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:08 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:08.413357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:08.414980 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:08.416305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a2f911ca-62f0-4634-a4f3-5942b8d7c2ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.304347 Aug 24 16:40:08.417008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 46/107] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:08 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:40:08.423797 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-562f59e0-adfd-4961-98ba-8f5cf9d01310 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:08.424505 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-562f59e0-adfd-4961-98ba-8f5cf9d01310 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:08.432727 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562f59e0-adfd-4961-98ba-8f5cf9d01310 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:08.433308 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562f59e0-adfd-4961-98ba-8f5cf9d01310 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:08.433756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562f59e0-adfd-4961-98ba-8f5cf9d01310 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:08.434454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562f59e0-adfd-4961-98ba-8f5cf9d01310 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:08.434905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562f59e0-adfd-4961-98ba-8f5cf9d01310 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:08.435331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562f59e0-adfd-4961-98ba-8f5cf9d01310 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:08.451010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=100 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:08.575424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-562f59e0-adfd-4961-98ba-8f5cf9d01310 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:08.584515 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-562f59e0-adfd-4961-98ba-8f5cf9d01310 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.174939 Aug 24 16:40:08.585111 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 62/108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:08 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:09.429628 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4cd07559-f24e-44b2-acc1-c67698ea738b tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:09.430238 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4cd07559-f24e-44b2-acc1-c67698ea738b tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:09.447937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cd07559-f24e-44b2-acc1-c67698ea738b tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:09.447937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cd07559-f24e-44b2-acc1-c67698ea738b tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:09.447937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cd07559-f24e-44b2-acc1-c67698ea738b tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:09.447937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cd07559-f24e-44b2-acc1-c67698ea738b tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:09.448301 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cd07559-f24e-44b2-acc1-c67698ea738b tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:09.448301 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cd07559-f24e-44b2-acc1-c67698ea738b tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:09.451320 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:09.452071 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:09.460822 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:09.461597 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:09.462135 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:09.463243 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:09.463795 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:09.464410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:09.672321 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4cd07559-f24e-44b2-acc1-c67698ea738b tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:09.675607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:09.681599 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4cd07559-f24e-44b2-acc1-c67698ea738b tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.256775 Aug 24 16:40:09.682280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 47/109] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:09 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:09.685259 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:09.686880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:09.687102 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a315ce30-1b98-4271-955f-75eae64ee14f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:09.687705 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a315ce30-1b98-4271-955f-75eae64ee14f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:09.688698 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2d102074-b58f-44c2-850e-130d35a2d55f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.251400 Aug 24 16:40:09.689353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 63/110] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:09 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:40:09.694607 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a315ce30-1b98-4271-955f-75eae64ee14f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:09.695092 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a315ce30-1b98-4271-955f-75eae64ee14f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:09.695648 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a315ce30-1b98-4271-955f-75eae64ee14f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:09.696463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a315ce30-1b98-4271-955f-75eae64ee14f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:09.696925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a315ce30-1b98-4271-955f-75eae64ee14f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:09.697345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a315ce30-1b98-4271-955f-75eae64ee14f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:09.888652 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a315ce30-1b98-4271-955f-75eae64ee14f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:09.896573 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a315ce30-1b98-4271-955f-75eae64ee14f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.212944 Aug 24 16:40:09.897139 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 48/111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:09 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:10.702524 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-78e91b4c-eccc-4ee9-ac92-11b696896dbc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:10.703132 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-78e91b4c-eccc-4ee9-ac92-11b696896dbc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:10.709496 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78e91b4c-eccc-4ee9-ac92-11b696896dbc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:10.709991 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78e91b4c-eccc-4ee9-ac92-11b696896dbc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:10.710427 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78e91b4c-eccc-4ee9-ac92-11b696896dbc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:10.711216 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78e91b4c-eccc-4ee9-ac92-11b696896dbc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:10.711717 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78e91b4c-eccc-4ee9-ac92-11b696896dbc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:10.712163 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78e91b4c-eccc-4ee9-ac92-11b696896dbc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:10.712436 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:10.713060 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:10.718944 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:10.719418 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:10.719840 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:10.720557 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:10.721009 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:10.721432 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:10.925619 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-78e91b4c-eccc-4ee9-ac92-11b696896dbc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:10.933774 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:10.934991 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-78e91b4c-eccc-4ee9-ac92-11b696896dbc tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.236269 Aug 24 16:40:10.935569 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 64/112] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:10 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:10.940190 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-51a14b38-4ce9-40cf-83f1-dcb05db77c76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:10.940888 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-51a14b38-4ce9-40cf-83f1-dcb05db77c76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:10.947549 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-51a14b38-4ce9-40cf-83f1-dcb05db77c76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:10.948757 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-51a14b38-4ce9-40cf-83f1-dcb05db77c76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:10.949400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-51a14b38-4ce9-40cf-83f1-dcb05db77c76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:10.951087 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-51a14b38-4ce9-40cf-83f1-dcb05db77c76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:10.951748 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-51a14b38-4ce9-40cf-83f1-dcb05db77c76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:10.952396 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-51a14b38-4ce9-40cf-83f1-dcb05db77c76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:10.955821 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:10.957422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:10.958526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-756c5766-26d0-4802-ae77-b592e07b93ad tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.249876 Aug 24 16:40:10.959254 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 49/113] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:10 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:40:11.090856 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-51a14b38-4ce9-40cf-83f1-dcb05db77c76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:11.099136 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-51a14b38-4ce9-40cf-83f1-dcb05db77c76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.162303 Aug 24 16:40:11.099714 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 65/114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:10 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:11.718793 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-fc205523-8bfa-4810-bc3a-071bfc8aca3d req-8b62ef40-c9d1-4d61-bd07-88fb00bfdc0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbd14e1-e123-4de5-a3a8-a05a401ee2fe", "name": "network-vif-plugged", "status": "completed", "tag": "10c3fbc7-c8f0-4c14-8a5c-d7edc10d3544"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:11.728893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-fc205523-8bfa-4810-bc3a-071bfc8aca3d req-8b62ef40-c9d1-4d61-bd07-88fb00bfdc0f service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:11.730001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-fc205523-8bfa-4810-bc3a-071bfc8aca3d req-8b62ef40-c9d1-4d61-bd07-88fb00bfdc0f service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:11.730978 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-fc205523-8bfa-4810-bc3a-071bfc8aca3d req-8b62ef40-c9d1-4d61-bd07-88fb00bfdc0f service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:11.746755 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-fc205523-8bfa-4810-bc3a-071bfc8aca3d req-8b62ef40-c9d1-4d61-bd07-88fb00bfdc0f service nova] Creating event network-vif-plugged:10c3fbc7-c8f0-4c14-8a5c-d7edc10d3544 for instance efbd14e1-e123-4de5-a3a8-a05a401ee2fe on hv-cinder-77957 Aug 24 16:40:11.752743 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-fc205523-8bfa-4810-bc3a-071bfc8aca3d req-8b62ef40-c9d1-4d61-bd07-88fb00bfdc0f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037486 Aug 24 16:40:11.753455 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 50/115] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:11.963909 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-18aafccb-478e-4280-ac2a-de6a6c41fe50 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:11.964535 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-18aafccb-478e-4280-ac2a-de6a6c41fe50 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:11.970718 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18aafccb-478e-4280-ac2a-de6a6c41fe50 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:11.971278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18aafccb-478e-4280-ac2a-de6a6c41fe50 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:11.971797 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18aafccb-478e-4280-ac2a-de6a6c41fe50 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:11.972624 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18aafccb-478e-4280-ac2a-de6a6c41fe50 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:11.973576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18aafccb-478e-4280-ac2a-de6a6c41fe50 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:11.974017 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18aafccb-478e-4280-ac2a-de6a6c41fe50 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:11.981082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:11.981767 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:11.988303 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:11.989640 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:11.990447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:11.991309 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:11.991920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:11.992511 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:12.170998 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-18aafccb-478e-4280-ac2a-de6a6c41fe50 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:12.179372 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-18aafccb-478e-4280-ac2a-de6a6c41fe50 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.221943 Aug 24 16:40:12.180053 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 66/116] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:11 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:12.184543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-102b3ee6-7cbe-4fd4-84ff-c13caa75616e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:12.185150 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-102b3ee6-7cbe-4fd4-84ff-c13caa75616e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:12.192384 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:12.194165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-102b3ee6-7cbe-4fd4-84ff-c13caa75616e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:12.194848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-102b3ee6-7cbe-4fd4-84ff-c13caa75616e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:12.195294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-102b3ee6-7cbe-4fd4-84ff-c13caa75616e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:12.196044 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-102b3ee6-7cbe-4fd4-84ff-c13caa75616e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:12.196502 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-102b3ee6-7cbe-4fd4-84ff-c13caa75616e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:12.196934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-102b3ee6-7cbe-4fd4-84ff-c13caa75616e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:12.200518 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:12.202028 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:12.203108 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4cee0269-a61a-4726-b96d-dcab0e919567 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.226207 Aug 24 16:40:12.203661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 51/117] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:11 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:40:12.329576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-102b3ee6-7cbe-4fd4-84ff-c13caa75616e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:12.338528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-102b3ee6-7cbe-4fd4-84ff-c13caa75616e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.157434 Aug 24 16:40:12.339104 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 67/118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:12 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:13.200483 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e7a119dd-7141-4a0d-9290-a98f2f34667c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:13.201123 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e7a119dd-7141-4a0d-9290-a98f2f34667c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:13.207205 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7a119dd-7141-4a0d-9290-a98f2f34667c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:13.207781 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7a119dd-7141-4a0d-9290-a98f2f34667c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:13.208441 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7a119dd-7141-4a0d-9290-a98f2f34667c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:13.209186 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7a119dd-7141-4a0d-9290-a98f2f34667c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:13.209646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7a119dd-7141-4a0d-9290-a98f2f34667c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:13.210074 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7a119dd-7141-4a0d-9290-a98f2f34667c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:13.227185 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:13.227848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:13.233632 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:13.234107 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:13.234534 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:13.235211 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:13.235770 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:13.236218 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:13.410504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e7a119dd-7141-4a0d-9290-a98f2f34667c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:13.413408 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:13.418175 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e7a119dd-7141-4a0d-9290-a98f2f34667c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.221650 Aug 24 16:40:13.418737 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 52/119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:13 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:13.421773 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:13.423324 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:13.424480 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-65af0832-f9d1-409c-9ad0-87660c322f01 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.201323 Aug 24 16:40:13.425170 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 68/120] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:13 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:40:13.429735 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-643971f5-c756-4c0f-ba9e-7bf9a18e033b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:13.430336 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-643971f5-c756-4c0f-ba9e-7bf9a18e033b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:13.436212 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-643971f5-c756-4c0f-ba9e-7bf9a18e033b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:13.436693 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-643971f5-c756-4c0f-ba9e-7bf9a18e033b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:13.437125 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-643971f5-c756-4c0f-ba9e-7bf9a18e033b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:13.437807 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-643971f5-c756-4c0f-ba9e-7bf9a18e033b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:13.438252 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-643971f5-c756-4c0f-ba9e-7bf9a18e033b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:13.438669 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-643971f5-c756-4c0f-ba9e-7bf9a18e033b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:13.568932 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-643971f5-c756-4c0f-ba9e-7bf9a18e033b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:13.576728 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-643971f5-c756-4c0f-ba9e-7bf9a18e033b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.151804 Aug 24 16:40:13.577295 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 53/121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:13 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:13.794484 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-2c87f88b-366e-4897-9cf4-92ef5505a250 req-ad79ffdf-5a74-4eb2-ae34-febe0996b764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad10931-9764-4362-a3b6-c5cd27974783", "name": "network-vif-plugged", "status": "completed", "tag": "8b8924d9-3ab9-4080-8066-5dffb8805604"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:13.804217 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-2c87f88b-366e-4897-9cf4-92ef5505a250 req-ad79ffdf-5a74-4eb2-ae34-febe0996b764 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:13.804684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-2c87f88b-366e-4897-9cf4-92ef5505a250 req-ad79ffdf-5a74-4eb2-ae34-febe0996b764 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:13.805102 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-2c87f88b-366e-4897-9cf4-92ef5505a250 req-ad79ffdf-5a74-4eb2-ae34-febe0996b764 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:13.815754 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-2c87f88b-366e-4897-9cf4-92ef5505a250 req-ad79ffdf-5a74-4eb2-ae34-febe0996b764 service nova] Creating event network-vif-plugged:8b8924d9-3ab9-4080-8066-5dffb8805604 for instance 1ad10931-9764-4362-a3b6-c5cd27974783 on hv-cinder-77957 Aug 24 16:40:13.821210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-2c87f88b-366e-4897-9cf4-92ef5505a250 req-ad79ffdf-5a74-4eb2-ae34-febe0996b764 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 Aug 24 16:40:13.821800 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 69/122] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:14.439239 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c3fa7fb1-a6d7-49c7-9a81-026222fd1650 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:14.439849 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c3fa7fb1-a6d7-49c7-9a81-026222fd1650 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:14.446138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3fa7fb1-a6d7-49c7-9a81-026222fd1650 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:14.446648 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3fa7fb1-a6d7-49c7-9a81-026222fd1650 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:14.446915 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:14.447313 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3fa7fb1-a6d7-49c7-9a81-026222fd1650 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:14.447602 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:14.447802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3fa7fb1-a6d7-49c7-9a81-026222fd1650 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:14.448374 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3fa7fb1-a6d7-49c7-9a81-026222fd1650 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:14.448802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3fa7fb1-a6d7-49c7-9a81-026222fd1650 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:14.453656 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:14.454155 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:14.454665 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:14.455299 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:14.455742 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:14.456191 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:14.680784 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:14.684491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c3fa7fb1-a6d7-49c7-9a81-026222fd1650 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:14.692044 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c3fa7fb1-a6d7-49c7-9a81-026222fd1650 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1314 microversion: 2.1 time: 0.256618 Aug 24 16:40:14.692225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:14.704038 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 54/123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:14 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:14.704400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:14.704400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d62aa991-7ea8-423a-b4ca-874f6ff0819d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.252326 Aug 24 16:40:14.704400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 70/124] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:14 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:40:14.704623 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-851a2b11-7852-43d9-9bc6-5a7466ca0867 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:14.704623 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-851a2b11-7852-43d9-9bc6-5a7466ca0867 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:14.704867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-851a2b11-7852-43d9-9bc6-5a7466ca0867 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:14.705683 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-851a2b11-7852-43d9-9bc6-5a7466ca0867 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:14.706801 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-851a2b11-7852-43d9-9bc6-5a7466ca0867 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:14.708419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-851a2b11-7852-43d9-9bc6-5a7466ca0867 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:14.708873 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-851a2b11-7852-43d9-9bc6-5a7466ca0867 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:14.709290 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-851a2b11-7852-43d9-9bc6-5a7466ca0867 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:14.842988 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-851a2b11-7852-43d9-9bc6-5a7466ca0867 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:14.851617 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-851a2b11-7852-43d9-9bc6-5a7466ca0867 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.157708 Aug 24 16:40:14.852226 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 55/125] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:14 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:15.714753 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8b513638-2551-437f-8c5b-5fd7c0316165 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:15.715384 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8b513638-2551-437f-8c5b-5fd7c0316165 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:15.717891 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:15.718524 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:15.721577 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8b513638-2551-437f-8c5b-5fd7c0316165 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:15.722062 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8b513638-2551-437f-8c5b-5fd7c0316165 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:15.722495 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8b513638-2551-437f-8c5b-5fd7c0316165 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:15.723716 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8b513638-2551-437f-8c5b-5fd7c0316165 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:15.724209 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8b513638-2551-437f-8c5b-5fd7c0316165 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:15.724632 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8b513638-2551-437f-8c5b-5fd7c0316165 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:15.724886 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:15.725365 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:15.725795 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:15.726467 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:15.726913 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:15.727328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:15.925696 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8b513638-2551-437f-8c5b-5fd7c0316165 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:15.929508 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:15.934144 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8b513638-2551-437f-8c5b-5fd7c0316165 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1500 microversion: 2.1 time: 0.223287 Aug 24 16:40:15.934802 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 71/126] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:15 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1500 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:15.938435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:15.939294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0e4ac591-6cf0-4945-a7af-25c621888f7b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:15.940042 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0e4ac591-6cf0-4945-a7af-25c621888f7b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:15.940181 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:15.941263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-32b1274f-cc29-4d96-94d0-eab60f3c4c8f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.227280 Aug 24 16:40:15.941978 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 56/127] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:15 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:40:15.946087 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e4ac591-6cf0-4945-a7af-25c621888f7b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:15.946567 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e4ac591-6cf0-4945-a7af-25c621888f7b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:15.946996 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e4ac591-6cf0-4945-a7af-25c621888f7b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:15.947680 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e4ac591-6cf0-4945-a7af-25c621888f7b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:15.948156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e4ac591-6cf0-4945-a7af-25c621888f7b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:15.948580 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e4ac591-6cf0-4945-a7af-25c621888f7b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:16.089506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0e4ac591-6cf0-4945-a7af-25c621888f7b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:16.097074 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0e4ac591-6cf0-4945-a7af-25c621888f7b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.161317 Aug 24 16:40:16.097641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 72/128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:15 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:16.964548 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:16.965067 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:16.970926 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:16.971398 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:16.971826 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:16.972532 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:16.972978 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:16.973502 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:17.117297 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:17.120834 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b4f30d30-1450-4577-a7e0-7888034a337f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:17.121443 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b4f30d30-1450-4577-a7e0-7888034a337f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:17.125463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:17.126954 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:17.127325 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4f30d30-1450-4577-a7e0-7888034a337f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:17.127807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4f30d30-1450-4577-a7e0-7888034a337f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:17.128063 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ed4a0e2e-9b7d-48bf-bf30-e74b73c07e99 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1405 microversion: 2.20 time: 0.167436 Aug 24 16:40:17.128271 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4f30d30-1450-4577-a7e0-7888034a337f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:17.128848 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 57/129] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:16 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:40:17.128975 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4f30d30-1450-4577-a7e0-7888034a337f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:17.130021 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4f30d30-1450-4577-a7e0-7888034a337f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:17.131105 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4f30d30-1450-4577-a7e0-7888034a337f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:17.264055 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b4f30d30-1450-4577-a7e0-7888034a337f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:17.272055 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b4f30d30-1450-4577-a7e0-7888034a337f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.154968 Aug 24 16:40:17.272625 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 73/130] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:17 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:18.152226 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:18.153549 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:18.156217 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=78 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:18.162048 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:18.162908 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:18.163513 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:18.164231 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:18.164687 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:18.165089 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:18.299427 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e0dd166c-2aac-417e-af11-443d7e7517d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:18.303017 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e0dd166c-2aac-417e-af11-443d7e7517d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:18.321359 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e0dd166c-2aac-417e-af11-443d7e7517d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:18.324119 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e0dd166c-2aac-417e-af11-443d7e7517d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:18.325005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e0dd166c-2aac-417e-af11-443d7e7517d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:18.326280 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e0dd166c-2aac-417e-af11-443d7e7517d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:18.328291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e0dd166c-2aac-417e-af11-443d7e7517d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:18.330097 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e0dd166c-2aac-417e-af11-443d7e7517d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:18.374798 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:18.385590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:18.387128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:18.388329 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-17b8d968-00fe-4c9d-b235-171b7e8e1bc6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1596 microversion: 2.20 time: 0.240024 Aug 24 16:40:18.416578 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 58/131] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:40:18 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1596 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:40:18.422517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-88043bb7-476e-4a79-b5b0-aac8ce451125 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:18.422997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-88043bb7-476e-4a79-b5b0-aac8ce451125 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:18.448361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88043bb7-476e-4a79-b5b0-aac8ce451125 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:18.448856 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88043bb7-476e-4a79-b5b0-aac8ce451125 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:18.449289 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88043bb7-476e-4a79-b5b0-aac8ce451125 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:18.450155 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88043bb7-476e-4a79-b5b0-aac8ce451125 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:18.451006 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88043bb7-476e-4a79-b5b0-aac8ce451125 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:18.451006 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88043bb7-476e-4a79-b5b0-aac8ce451125 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:18.712374 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-88043bb7-476e-4a79-b5b0-aac8ce451125 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.294550 Aug 24 16:40:18.713140 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 59/132] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Aug 24 16:40:18 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-interface => generated 284 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:40:18.718397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7a18e463-d69a-4045-9ceb-c532ec44ee4e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a5c6f53-df4c-4d39-86eb-58fba9482cb1"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:18.722466 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7a18e463-d69a-4045-9ceb-c532ec44ee4e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:18.731571 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a18e463-d69a-4045-9ceb-c532ec44ee4e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:18.732392 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a18e463-d69a-4045-9ceb-c532ec44ee4e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:18.733153 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a18e463-d69a-4045-9ceb-c532ec44ee4e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:18.734070 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a18e463-d69a-4045-9ceb-c532ec44ee4e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:18.734737 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a18e463-d69a-4045-9ceb-c532ec44ee4e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:18.735357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a18e463-d69a-4045-9ceb-c532ec44ee4e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:18.777769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e0dd166c-2aac-417e-af11-443d7e7517d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:18.785891 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e0dd166c-2aac-417e-af11-443d7e7517d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.497089 Aug 24 16:40:18.786474 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 74/133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:18 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:19.365509 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7a18e463-d69a-4045-9ceb-c532ec44ee4e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "POST /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.650393 Aug 24 16:40:19.367195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 60/134] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:40:18 2022] POST /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:19.806991 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ca5cfd5d-127e-4e6f-a315-f4f9d0d1f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:19.807590 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ca5cfd5d-127e-4e6f-a315-f4f9d0d1f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:19.813962 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca5cfd5d-127e-4e6f-a315-f4f9d0d1f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:19.814446 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca5cfd5d-127e-4e6f-a315-f4f9d0d1f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:19.814873 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca5cfd5d-127e-4e6f-a315-f4f9d0d1f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:19.815557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca5cfd5d-127e-4e6f-a315-f4f9d0d1f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:19.816026 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca5cfd5d-127e-4e6f-a315-f4f9d0d1f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:19.816460 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca5cfd5d-127e-4e6f-a315-f4f9d0d1f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:19.955142 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ca5cfd5d-127e-4e6f-a315-f4f9d0d1f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:19.964333 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ca5cfd5d-127e-4e6f-a315-f4f9d0d1f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.161085 Aug 24 16:40:19.965059 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 75/135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:19 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:20.202174 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-6d490833-107d-4a8b-a9a1-bcfff02e4ba0 req-0e406d46-9e3f-441b-a23d-d3ae53bcd778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66f46124-a6dc-4300-88a6-3143240719da", "tag": "f4013556-5bff-4eef-bfeb-7c2f27b64c4a"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:20.215288 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6d490833-107d-4a8b-a9a1-bcfff02e4ba0 req-0e406d46-9e3f-441b-a23d-d3ae53bcd778 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:20.218974 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6d490833-107d-4a8b-a9a1-bcfff02e4ba0 req-0e406d46-9e3f-441b-a23d-d3ae53bcd778 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:20.219420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6d490833-107d-4a8b-a9a1-bcfff02e4ba0 req-0e406d46-9e3f-441b-a23d-d3ae53bcd778 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:20.231142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-6d490833-107d-4a8b-a9a1-bcfff02e4ba0 req-0e406d46-9e3f-441b-a23d-d3ae53bcd778 service nova] Creating event network-changed:f4013556-5bff-4eef-bfeb-7c2f27b64c4a for instance 66f46124-a6dc-4300-88a6-3143240719da on hv-cinder-77957 Aug 24 16:40:20.239559 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-6d490833-107d-4a8b-a9a1-bcfff02e4ba0 req-0e406d46-9e3f-441b-a23d-d3ae53bcd778 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041307 Aug 24 16:40:20.240799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 61/136] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:20.990371 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7d5f88d8-2973-467b-944e-3e91671d3814 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:20.992431 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-7d5f88d8-2973-467b-944e-3e91671d3814 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:21.000117 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7d5f88d8-2973-467b-944e-3e91671d3814 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:21.001286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7d5f88d8-2973-467b-944e-3e91671d3814 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:21.002002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7d5f88d8-2973-467b-944e-3e91671d3814 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:21.002926 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7d5f88d8-2973-467b-944e-3e91671d3814 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:21.003590 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7d5f88d8-2973-467b-944e-3e91671d3814 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:21.006871 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7d5f88d8-2973-467b-944e-3e91671d3814 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:21.207688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-7d5f88d8-2973-467b-944e-3e91671d3814 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:21.218109 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7d5f88d8-2973-467b-944e-3e91671d3814 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.235154 Aug 24 16:40:21.218696 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 76/137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:20 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:22.246521 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0cdd9a9f-ea40-4761-8948-51cfaf6b1606 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:22.247861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0cdd9a9f-ea40-4761-8948-51cfaf6b1606 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:22.257182 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0cdd9a9f-ea40-4761-8948-51cfaf6b1606 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:22.258541 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0cdd9a9f-ea40-4761-8948-51cfaf6b1606 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:22.259192 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0cdd9a9f-ea40-4761-8948-51cfaf6b1606 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:22.260271 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0cdd9a9f-ea40-4761-8948-51cfaf6b1606 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:22.261302 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0cdd9a9f-ea40-4761-8948-51cfaf6b1606 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:22.262421 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0cdd9a9f-ea40-4761-8948-51cfaf6b1606 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:22.293614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:22.482555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-0cdd9a9f-ea40-4761-8948-51cfaf6b1606 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:22.493562 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0cdd9a9f-ea40-4761-8948-51cfaf6b1606 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1321 microversion: 2.1 time: 0.255947 Aug 24 16:40:22.510649 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 62/138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:22 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:23.514954 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f0a280d4-95e7-4788-a8fc-94454748c874 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:23.515594 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f0a280d4-95e7-4788-a8fc-94454748c874 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:23.522564 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f0a280d4-95e7-4788-a8fc-94454748c874 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:23.523057 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f0a280d4-95e7-4788-a8fc-94454748c874 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:23.523812 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f0a280d4-95e7-4788-a8fc-94454748c874 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:23.524726 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f0a280d4-95e7-4788-a8fc-94454748c874 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:23.525410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f0a280d4-95e7-4788-a8fc-94454748c874 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:23.526058 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f0a280d4-95e7-4788-a8fc-94454748c874 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:23.744274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f0a280d4-95e7-4788-a8fc-94454748c874 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:23.766647 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f0a280d4-95e7-4788-a8fc-94454748c874 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1514 microversion: 2.1 time: 0.255590 Aug 24 16:40:23.793944 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 77/139] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:23 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1514 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:23.805235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-709c2036-d3dd-4106-bc40-dd86a05dea77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:23.807604 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-709c2036-d3dd-4106-bc40-dd86a05dea77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:23.814866 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-709c2036-d3dd-4106-bc40-dd86a05dea77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:23.816503 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-709c2036-d3dd-4106-bc40-dd86a05dea77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:23.817906 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-709c2036-d3dd-4106-bc40-dd86a05dea77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:23.818786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-709c2036-d3dd-4106-bc40-dd86a05dea77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:23.819405 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-709c2036-d3dd-4106-bc40-dd86a05dea77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:23.820280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-709c2036-d3dd-4106-bc40-dd86a05dea77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:23.845583 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.objects.instance [None req-709c2036-d3dd-4106-bc40-dd86a05dea77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lazy-loading 'flavor' on Instance uuid efbd14e1-e123-4de5-a3a8-a05a401ee2fe {{(pid=127165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:40:23.984190 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-709c2036-d3dd-4106-bc40-dd86a05dea77 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe/action" status: 200 len: 32 microversion: 2.1 time: 0.184355 Aug 24 16:40:23.984992 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 63/140] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:40:23 2022] POST /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:40:23.996605 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f9f8a0fc-4adf-4e73-88c8-3c0ae7d38dba tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:23.998209 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f9f8a0fc-4adf-4e73-88c8-3c0ae7d38dba tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:24.006983 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9f8a0fc-4adf-4e73-88c8-3c0ae7d38dba tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:24.008061 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9f8a0fc-4adf-4e73-88c8-3c0ae7d38dba tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:24.008724 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9f8a0fc-4adf-4e73-88c8-3c0ae7d38dba tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:24.014960 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9f8a0fc-4adf-4e73-88c8-3c0ae7d38dba tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:24.015704 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9f8a0fc-4adf-4e73-88c8-3c0ae7d38dba tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:24.018197 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9f8a0fc-4adf-4e73-88c8-3c0ae7d38dba tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:24.344849 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f9f8a0fc-4adf-4e73-88c8-3c0ae7d38dba tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:24.354571 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f9f8a0fc-4adf-4e73-88c8-3c0ae7d38dba tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.363143 Aug 24 16:40:24.369319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 78/141] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:23 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:25.382655 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9191e6a8-ec14-433f-9a2e-4b7f24ef9465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:25.383597 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9191e6a8-ec14-433f-9a2e-4b7f24ef9465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:25.413038 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9191e6a8-ec14-433f-9a2e-4b7f24ef9465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:25.415162 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9191e6a8-ec14-433f-9a2e-4b7f24ef9465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:25.415830 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9191e6a8-ec14-433f-9a2e-4b7f24ef9465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:25.418047 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9191e6a8-ec14-433f-9a2e-4b7f24ef9465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:25.419878 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9191e6a8-ec14-433f-9a2e-4b7f24ef9465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:25.420531 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9191e6a8-ec14-433f-9a2e-4b7f24ef9465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:25.612174 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9191e6a8-ec14-433f-9a2e-4b7f24ef9465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:25.625318 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9191e6a8-ec14-433f-9a2e-4b7f24ef9465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.249800 Aug 24 16:40:25.635231 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 64/142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:25 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:26.646865 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-bbf62127-233b-424a-96f9-464a5ef609ed tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:26.648250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-bbf62127-233b-424a-96f9-464a5ef609ed tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:26.654327 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=68 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:26.655873 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbf62127-233b-424a-96f9-464a5ef609ed tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:26.656572 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbf62127-233b-424a-96f9-464a5ef609ed tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:26.657049 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbf62127-233b-424a-96f9-464a5ef609ed tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:26.657745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbf62127-233b-424a-96f9-464a5ef609ed tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:26.658199 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbf62127-233b-424a-96f9-464a5ef609ed tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:26.658620 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbf62127-233b-424a-96f9-464a5ef609ed tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:26.811768 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-bbf62127-233b-424a-96f9-464a5ef609ed tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:26.814513 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=100 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:26.821701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-bbf62127-233b-424a-96f9-464a5ef609ed tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.180048 Aug 24 16:40:26.822274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 79/143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:26 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:27.842813 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-32213fa7-3f41-48d6-b6a1-2448fff545de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:27.844050 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-32213fa7-3f41-48d6-b6a1-2448fff545de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:27.851518 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32213fa7-3f41-48d6-b6a1-2448fff545de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:27.852254 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32213fa7-3f41-48d6-b6a1-2448fff545de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:27.852694 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32213fa7-3f41-48d6-b6a1-2448fff545de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:27.853450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32213fa7-3f41-48d6-b6a1-2448fff545de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:27.854096 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32213fa7-3f41-48d6-b6a1-2448fff545de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:27.854525 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32213fa7-3f41-48d6-b6a1-2448fff545de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:28.213037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-32213fa7-3f41-48d6-b6a1-2448fff545de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:28.220366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-32213fa7-3f41-48d6-b6a1-2448fff545de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.381136 Aug 24 16:40:28.220994 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 65/144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:27 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:29.242720 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-88a38fec-517e-415a-88ba-2fc3356dffdf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:29.244181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-88a38fec-517e-415a-88ba-2fc3356dffdf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:29.250484 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88a38fec-517e-415a-88ba-2fc3356dffdf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:29.250963 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88a38fec-517e-415a-88ba-2fc3356dffdf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:29.251390 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88a38fec-517e-415a-88ba-2fc3356dffdf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:29.252289 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88a38fec-517e-415a-88ba-2fc3356dffdf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:29.252738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88a38fec-517e-415a-88ba-2fc3356dffdf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:29.253151 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88a38fec-517e-415a-88ba-2fc3356dffdf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:29.390472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-88a38fec-517e-415a-88ba-2fc3356dffdf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:29.399480 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-88a38fec-517e-415a-88ba-2fc3356dffdf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.161669 Aug 24 16:40:29.400082 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 80/145] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:29 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:30.421066 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8f4d1123-1be5-448c-9352-f6a3173fc279 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:30.421782 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8f4d1123-1be5-448c-9352-f6a3173fc279 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:30.429580 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4d1123-1be5-448c-9352-f6a3173fc279 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:30.430260 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4d1123-1be5-448c-9352-f6a3173fc279 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:30.430696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4d1123-1be5-448c-9352-f6a3173fc279 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:30.431393 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4d1123-1be5-448c-9352-f6a3173fc279 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:30.431843 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4d1123-1be5-448c-9352-f6a3173fc279 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:30.432297 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4d1123-1be5-448c-9352-f6a3173fc279 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:30.597728 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8f4d1123-1be5-448c-9352-f6a3173fc279 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:30.607059 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8f4d1123-1be5-448c-9352-f6a3173fc279 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.189707 Aug 24 16:40:30.607628 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 66/146] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:30 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:31.629544 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fe28068b-48d1-4637-b108-d2b0a0fe2d04 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:31.630165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fe28068b-48d1-4637-b108-d2b0a0fe2d04 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:31.638221 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe28068b-48d1-4637-b108-d2b0a0fe2d04 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:31.638866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe28068b-48d1-4637-b108-d2b0a0fe2d04 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:31.639468 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe28068b-48d1-4637-b108-d2b0a0fe2d04 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:31.640207 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe28068b-48d1-4637-b108-d2b0a0fe2d04 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:31.640667 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe28068b-48d1-4637-b108-d2b0a0fe2d04 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:31.641095 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe28068b-48d1-4637-b108-d2b0a0fe2d04 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:31.873533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fe28068b-48d1-4637-b108-d2b0a0fe2d04 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:31.882603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-fe28068b-48d1-4637-b108-d2b0a0fe2d04 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.257247 Aug 24 16:40:31.883176 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 81/147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:31 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:32.648328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-54c1b6eb-862d-4a0a-9d46-388a2383c5eb tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:32.648954 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-54c1b6eb-862d-4a0a-9d46-388a2383c5eb tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:32.655970 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54c1b6eb-862d-4a0a-9d46-388a2383c5eb tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:32.656575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54c1b6eb-862d-4a0a-9d46-388a2383c5eb tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:32.657080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54c1b6eb-862d-4a0a-9d46-388a2383c5eb tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:32.657876 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54c1b6eb-862d-4a0a-9d46-388a2383c5eb tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:32.658478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54c1b6eb-862d-4a0a-9d46-388a2383c5eb tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:32.658947 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54c1b6eb-862d-4a0a-9d46-388a2383c5eb tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:32.727347 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-54c1b6eb-862d-4a0a-9d46-388a2383c5eb tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:40:32.881905 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-54c1b6eb-862d-4a0a-9d46-388a2383c5eb tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 204 len: 0 microversion: 2.1 time: 0.235025 Aug 24 16:40:32.883368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 67/148] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:40:32 2022] DELETE /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:40:32.898570 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6f76dc39-03fb-4fae-8b78-b34811ec381e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:32.900091 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6f76dc39-03fb-4fae-8b78-b34811ec381e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:32.905640 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9f3a8751-2e9d-48f0-85d6-37a5ac8e85f0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:32.906695 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9f3a8751-2e9d-48f0-85d6-37a5ac8e85f0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:32.914626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3a8751-2e9d-48f0-85d6-37a5ac8e85f0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:32.915392 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3a8751-2e9d-48f0-85d6-37a5ac8e85f0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:32.916137 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3a8751-2e9d-48f0-85d6-37a5ac8e85f0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:32.917147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3a8751-2e9d-48f0-85d6-37a5ac8e85f0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:32.917786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3a8751-2e9d-48f0-85d6-37a5ac8e85f0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:32.918009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f76dc39-03fb-4fae-8b78-b34811ec381e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:32.918710 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3a8751-2e9d-48f0-85d6-37a5ac8e85f0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:32.920259 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f76dc39-03fb-4fae-8b78-b34811ec381e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:32.920716 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f76dc39-03fb-4fae-8b78-b34811ec381e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:32.921431 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f76dc39-03fb-4fae-8b78-b34811ec381e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:32.922296 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f76dc39-03fb-4fae-8b78-b34811ec381e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:32.922296 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f76dc39-03fb-4fae-8b78-b34811ec381e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:33.289385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9f3a8751-2e9d-48f0-85d6-37a5ac8e85f0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:33.291352 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6f76dc39-03fb-4fae-8b78-b34811ec381e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:33.301276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6f76dc39-03fb-4fae-8b78-b34811ec381e tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1552 microversion: 2.1 time: 0.412246 Aug 24 16:40:33.302143 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 82/149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:32 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1552 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:33.305100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9f3a8751-2e9d-48f0-85d6-37a5ac8e85f0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.404874 Aug 24 16:40:33.306149 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 68/150] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:32 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:34.333906 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f9422a88-8ff1-4ea2-b0ba-f7febba4ee3a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:34.334536 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f9422a88-8ff1-4ea2-b0ba-f7febba4ee3a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:34.338281 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-eb9993bd-7a74-4065-bdd8-7acd34bc17fe tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:34.339507 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-eb9993bd-7a74-4065-bdd8-7acd34bc17fe tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:34.343591 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9422a88-8ff1-4ea2-b0ba-f7febba4ee3a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:34.344545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9422a88-8ff1-4ea2-b0ba-f7febba4ee3a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:34.344985 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9422a88-8ff1-4ea2-b0ba-f7febba4ee3a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:34.350019 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9422a88-8ff1-4ea2-b0ba-f7febba4ee3a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:34.350734 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9422a88-8ff1-4ea2-b0ba-f7febba4ee3a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:34.350853 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-eb9993bd-7a74-4065-bdd8-7acd34bc17fe tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:34.351445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f9422a88-8ff1-4ea2-b0ba-f7febba4ee3a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:34.351561 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-eb9993bd-7a74-4065-bdd8-7acd34bc17fe tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:34.352558 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-eb9993bd-7a74-4065-bdd8-7acd34bc17fe tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:34.353491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-eb9993bd-7a74-4065-bdd8-7acd34bc17fe tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:34.354206 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-eb9993bd-7a74-4065-bdd8-7acd34bc17fe tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:34.355596 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-eb9993bd-7a74-4065-bdd8-7acd34bc17fe tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:34.809554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f9422a88-8ff1-4ea2-b0ba-f7febba4ee3a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:34.814053 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-eb9993bd-7a74-4065-bdd8-7acd34bc17fe tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:34.829664 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-eb9993bd-7a74-4065-bdd8-7acd34bc17fe tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.498089 Aug 24 16:40:34.830575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 69/151] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:34 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:34.831809 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f9422a88-8ff1-4ea2-b0ba-f7febba4ee3a tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1552 microversion: 2.1 time: 0.501882 Aug 24 16:40:34.833452 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 83/152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:34 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1552 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:35.855208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7781210a-2f15-43c1-a3f1-df6c96c6aa31 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:35.855817 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7781210a-2f15-43c1-a3f1-df6c96c6aa31 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:35.860621 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e5214405-ce9d-458a-a00b-2358f53a93d6 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:35.866886 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7781210a-2f15-43c1-a3f1-df6c96c6aa31 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:35.867752 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e5214405-ce9d-458a-a00b-2358f53a93d6 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:35.870678 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7781210a-2f15-43c1-a3f1-df6c96c6aa31 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:35.872047 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7781210a-2f15-43c1-a3f1-df6c96c6aa31 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:35.874047 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7781210a-2f15-43c1-a3f1-df6c96c6aa31 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:35.875414 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7781210a-2f15-43c1-a3f1-df6c96c6aa31 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:35.888297 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7781210a-2f15-43c1-a3f1-df6c96c6aa31 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:35.893605 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5214405-ce9d-458a-a00b-2358f53a93d6 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:35.904371 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5214405-ce9d-458a-a00b-2358f53a93d6 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:35.906480 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5214405-ce9d-458a-a00b-2358f53a93d6 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:35.916264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5214405-ce9d-458a-a00b-2358f53a93d6 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:35.917176 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5214405-ce9d-458a-a00b-2358f53a93d6 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:35.918708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5214405-ce9d-458a-a00b-2358f53a93d6 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:36.415894 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7781210a-2f15-43c1-a3f1-df6c96c6aa31 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:36.424731 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7781210a-2f15-43c1-a3f1-df6c96c6aa31 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.573847 Aug 24 16:40:36.425347 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 70/153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:35 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:36.453933 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-d8e9fecc-a872-47d3-a2c4-713187e6bee9 req-83c97710-4589-427a-85d5-6298a02fa688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebb90c5-4e6c-4359-bc7f-f0d247ca9293", "name": "network-vif-deleted", "tag": "efdbc14e-ee09-47f3-861d-ae7f753b3478"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:36.476331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e5214405-ce9d-458a-a00b-2358f53a93d6 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:36.498972 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e5214405-ce9d-458a-a00b-2358f53a93d6 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1552 microversion: 2.1 time: 0.647888 Aug 24 16:40:36.500922 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 84/154] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:35 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1552 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:36.505199 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-d8e9fecc-a872-47d3-a2c4-713187e6bee9 req-83c97710-4589-427a-85d5-6298a02fa688 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:36.505691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-d8e9fecc-a872-47d3-a2c4-713187e6bee9 req-83c97710-4589-427a-85d5-6298a02fa688 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:36.506144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-d8e9fecc-a872-47d3-a2c4-713187e6bee9 req-83c97710-4589-427a-85d5-6298a02fa688 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:36.536448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-d8e9fecc-a872-47d3-a2c4-713187e6bee9 req-83c97710-4589-427a-85d5-6298a02fa688 service nova] Creating event network-vif-deleted:efdbc14e-ee09-47f3-861d-ae7f753b3478 for instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 on hv-cinder-77957 Aug 24 16:40:36.553044 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-d8e9fecc-a872-47d3-a2c4-713187e6bee9 req-83c97710-4589-427a-85d5-6298a02fa688 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114445 Aug 24 16:40:36.560315 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 71/155] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:37.453383 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dbd02805-52ed-422d-b7f7-3f1742b71a64 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:37.454003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-dbd02805-52ed-422d-b7f7-3f1742b71a64 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:37.470184 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbd02805-52ed-422d-b7f7-3f1742b71a64 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:37.470689 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbd02805-52ed-422d-b7f7-3f1742b71a64 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:37.471170 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbd02805-52ed-422d-b7f7-3f1742b71a64 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:37.471886 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbd02805-52ed-422d-b7f7-3f1742b71a64 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:37.474152 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbd02805-52ed-422d-b7f7-3f1742b71a64 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:37.480013 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbd02805-52ed-422d-b7f7-3f1742b71a64 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:37.525701 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:37.526653 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:37.540149 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:37.540789 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:37.541259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:37.550519 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:37.550519 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:37.554561 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:37.661339 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:37.664022 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:37.664488 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:37.665150 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.objects.instance [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lazy-loading 'fault' on Instance uuid aebb90c5-4e6c-4359-bc7f-f0d247ca9293 {{(pid=127165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:40:37.767314 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05e175cab43245d7b35df0adc8564394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09380cc0f03944468d21fa2571e992d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:37.777740 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6c20b09c-f31b-4d8d-a548-18d8deb573ed tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 200 len: 1304 microversion: 2.1 time: 0.256691 Aug 24 16:40:37.794143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 72/156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:37 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 1304 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:37.807005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-dbd02805-52ed-422d-b7f7-3f1742b71a64 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:37.815598 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-dbd02805-52ed-422d-b7f7-3f1742b71a64 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.367274 Aug 24 16:40:37.829115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 85/157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:37 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:38.800294 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:38.802025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:38.808277 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:38.809015 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:38.809632 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:38.810639 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:38.811087 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:38.811665 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:38.836916 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f2b507be-e0d5-4b4a-a81d-650147111505 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:38.837748 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f2b507be-e0d5-4b4a-a81d-650147111505 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:38.841949 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] HTTP exception thrown: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:38.845264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2b507be-e0d5-4b4a-a81d-650147111505 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:38.845751 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2b507be-e0d5-4b4a-a81d-650147111505 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:38.846187 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2b507be-e0d5-4b4a-a81d-650147111505 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:38.846874 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2b507be-e0d5-4b4a-a81d-650147111505 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:38.847397 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2b507be-e0d5-4b4a-a81d-650147111505 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:38.847792 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2b507be-e0d5-4b4a-a81d-650147111505 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Request method failure captured: Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 HTTP/1.1 Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlQ6N16mcEG7tpAg9rDpjN0nvryOzB82OezYxEwksmGkdKPWXUnLv3DGQuczP1ZbL6SEufCir3L7PXj2_bAUr-Dv8VFmieQrd3UKaUznKQo-AbSOkM4bYHjd1B9_ZGf8LS-Qk-5KVRAK9CUxZ-rjnOeE1x_OU6TScIw7p46NLydB0F4 Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 09380cc0f03944468d21fa2571e992d0 Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:40:38.866927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09380cc0f03944468d21fa2571e992d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 09380cc0f03944468d21fa2571e992d0 Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-DeleteServersTestJSON-2110289977-project Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 05e175cab43245d7b35df0adc8564394 Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-DeleteServersTestJSON-2110289977-project Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:38.868164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'aebb90c5-4e6c-4359-bc7f-f0d247ca9293'} Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:40:38.869014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:38.870338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:38.872916 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Returning 404 to user: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:40:38.872916 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c3b9f129-cf10-4bf3-9b4d-94a70a779484 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 404 len: 111 microversion: 2.1 time: 0.072627 Aug 24 16:40:38.872916 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 73/158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:38 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:40:39.018101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f2b507be-e0d5-4b4a-a81d-650147111505 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:39.028052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f2b507be-e0d5-4b4a-a81d-650147111505 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.194791 Aug 24 16:40:39.029186 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 86/159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:38 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:39.311367 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:39.314760 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:39.331578 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:39.332957 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:39.333548 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:39.334466 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:39.335062 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:39.338034 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:39.370455 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] HTTP exception thrown: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Request method failure captured: Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293/os-volume_attachments HTTP/1.1 Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlQ6N16mcEG7tpAg9rDpjN0nvryOzB82OezYxEwksmGkdKPWXUnLv3DGQuczP1ZbL6SEufCir3L7PXj2_bAUr-Dv8VFmieQrd3UKaUznKQo-AbSOkM4bYHjd1B9_ZGf8LS-Qk-5KVRAK9CUxZ-rjnOeE1x_OU6TScIw7p46NLydB0F4 Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 09380cc0f03944468d21fa2571e992d0 Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:40:39.372827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09380cc0f03944468d21fa2571e992d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 09380cc0f03944468d21fa2571e992d0 Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-DeleteServersTestJSON-2110289977-project Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 05e175cab43245d7b35df0adc8564394 Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-DeleteServersTestJSON-2110289977-project Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:39.374722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'server_id': 'aebb90c5-4e6c-4359-bc7f-f0d247ca9293'} Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:40:39.375456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:39.376786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:39.379479 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Returning 404 to user: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:40:39.379479 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-73d957dc-5d0a-408e-b6a3-a054a7e12906 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.067116 Aug 24 16:40:39.381167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 74/160] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:40:39 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293/os-volume_attachments => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:40:40.051529 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ee0e5c2c-e7a7-4abb-8357-2dd6321cb768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:40.052887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ee0e5c2c-e7a7-4abb-8357-2dd6321cb768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:40.060458 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ee0e5c2c-e7a7-4abb-8357-2dd6321cb768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:40.061736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ee0e5c2c-e7a7-4abb-8357-2dd6321cb768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:40.062188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ee0e5c2c-e7a7-4abb-8357-2dd6321cb768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:40.062893 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ee0e5c2c-e7a7-4abb-8357-2dd6321cb768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:40.063346 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ee0e5c2c-e7a7-4abb-8357-2dd6321cb768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:40.064110 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ee0e5c2c-e7a7-4abb-8357-2dd6321cb768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:40.191887 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-595251049", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "networks": [{"uuid": "a492a2d3-2313-422d-b78f-b12dffc5a834"}]}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:40.218361 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ee0e5c2c-e7a7-4abb-8357-2dd6321cb768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:40.227247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ee0e5c2c-e7a7-4abb-8357-2dd6321cb768 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.181396 Aug 24 16:40:40.227807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 87/161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:40 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:40.256613 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] validate_networks() for [('a492a2d3-2313-422d-b78f-b12dffc5a834', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:40:40.701836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:40.702534 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:40.711180 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:40.712693 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:40.713282 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:40.717824 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:40.718567 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:40.719007 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:40.748777 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] HTTP exception thrown: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Request method failure captured: Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: DELETE /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 HTTP/1.1 Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQ6N16mcEG7tpAg9rDpjN0nvryOzB82OezYxEwksmGkdKPWXUnLv3DGQuczP1ZbL6SEufCir3L7PXj2_bAUr-Dv8VFmieQrd3UKaUznKQo-AbSOkM4bYHjd1B9_ZGf8LS-Qk-5KVRAK9CUxZ-rjnOeE1x_OU6TScIw7p46NLydB0F4 Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 09380cc0f03944468d21fa2571e992d0 Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:40:40.758804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09380cc0f03944468d21fa2571e992d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 09380cc0f03944468d21fa2571e992d0 Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-DeleteServersTestJSON-2110289977-project Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 05e175cab43245d7b35df0adc8564394 Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-DeleteServersTestJSON-2110289977-project Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:40.760038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'aebb90c5-4e6c-4359-bc7f-f0d247ca9293'} Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:40:40.760670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:40.761763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:40:40.768493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Returning 404 to user: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:40:40.772078 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-dfe4216c-3bd7-42d3-9228-f748294f6c4c tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 404 len: 111 microversion: 2.1 time: 0.073919 Aug 24 16:40:40.772922 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 88/162] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:40:40 2022] DELETE /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:40:40.776310 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:40:40.776739 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:40:40.777681 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:40:40.778116 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:40:40.779227 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:40:40.782434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:40.783592 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] [instance: aebb90c5-4e6c-4359-bc7f-f0d247ca9293] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:40.791151 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:40.792593 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:40.793929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:40.795609 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:40.796291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:40.801106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:40.802149 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:40.804317 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:40.804805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:40.805600 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:40.806099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:40.806524 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:40.820574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] HTTP exception thrown: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Request method failure captured: Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 HTTP/1.1 Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQ6N16mcEG7tpAg9rDpjN0nvryOzB82OezYxEwksmGkdKPWXUnLv3DGQuczP1ZbL6SEufCir3L7PXj2_bAUr-Dv8VFmieQrd3UKaUznKQo-AbSOkM4bYHjd1B9_ZGf8LS-Qk-5KVRAK9CUxZ-rjnOeE1x_OU6TScIw7p46NLydB0F4 Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 09380cc0f03944468d21fa2571e992d0 Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:40:40.822353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09380cc0f03944468d21fa2571e992d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09380cc0f03944468d21fa2571e992d0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 09380cc0f03944468d21fa2571e992d0 Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110289977 Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-DeleteServersTestJSON-2110289977-project Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 05e175cab43245d7b35df0adc8564394 Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-DeleteServersTestJSON-2110289977-project Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:40.823669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'aebb90c5-4e6c-4359-bc7f-f0d247ca9293'} Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:40:40.824316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. Aug 24 16:40:40.825341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:40:40.827615 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] Returning 404 to user: Instance aebb90c5-4e6c-4359-bc7f-f0d247ca9293 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:40:40.828686 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d515f81b-13a6-4df2-96a1-d8888fa4cbb2 tempest-DeleteServersTestJSON-2110289977 tempest-DeleteServersTestJSON-2110289977-project] 10.222.0.52 "GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293" status: 404 len: 111 microversion: 2.1 time: 0.051006 Aug 24 16:40:40.830870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 89/163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:40 2022] GET /compute/v2.1/servers/aebb90c5-4e6c-4359-bc7f-f0d247ca9293 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:40:40.855569 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Getting quotas for project 8424741e1d154c6c9b08b19fb7c61d33. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:40:40.869579 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Getting quotas for user e4b36e6959444273872c300742d6ddb8 and project 8424741e1d154c6c9b08b19fb7c61d33. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:40:40.905052 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:40:40.913614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:40:41.072222 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-83723331-d332-4e43-9e87-43d27ed03fbd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885680 Aug 24 16:40:41.076707 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 75/164] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:40:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 16:40:41.090108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-bb2665bc-749c-4529-b55d-d331cdacdffb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:41.090621 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-bb2665bc-749c-4529-b55d-d331cdacdffb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:41.213396 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-bb2665bc-749c-4529-b55d-d331cdacdffb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:41.232049 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-bb2665bc-749c-4529-b55d-d331cdacdffb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1213 microversion: 2.1 time: 0.144666 Aug 24 16:40:41.240691 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 90/165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:41 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:41.250147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-93a509f7-27f1-4d35-aa20-9f6de7a01e2c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:41.250759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-93a509f7-27f1-4d35-aa20-9f6de7a01e2c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:41.274603 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93a509f7-27f1-4d35-aa20-9f6de7a01e2c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:41.277949 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93a509f7-27f1-4d35-aa20-9f6de7a01e2c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:41.278653 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93a509f7-27f1-4d35-aa20-9f6de7a01e2c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:41.279378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93a509f7-27f1-4d35-aa20-9f6de7a01e2c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:41.279827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93a509f7-27f1-4d35-aa20-9f6de7a01e2c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:41.280325 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93a509f7-27f1-4d35-aa20-9f6de7a01e2c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:41.615338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-93a509f7-27f1-4d35-aa20-9f6de7a01e2c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:41.625648 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-93a509f7-27f1-4d35-aa20-9f6de7a01e2c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.377736 Aug 24 16:40:41.642280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 76/166] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:41 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:42.257291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d7c3e6bd-4a6b-4b65-889a-4536f0896730 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:42.258689 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d7c3e6bd-4a6b-4b65-889a-4536f0896730 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:42.268088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7c3e6bd-4a6b-4b65-889a-4536f0896730 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:42.268958 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7c3e6bd-4a6b-4b65-889a-4536f0896730 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:42.269922 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7c3e6bd-4a6b-4b65-889a-4536f0896730 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:42.270840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7c3e6bd-4a6b-4b65-889a-4536f0896730 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:42.271481 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7c3e6bd-4a6b-4b65-889a-4536f0896730 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:42.272138 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7c3e6bd-4a6b-4b65-889a-4536f0896730 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:42.354754 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d7c3e6bd-4a6b-4b65-889a-4536f0896730 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:42.364573 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d7c3e6bd-4a6b-4b65-889a-4536f0896730 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1265 microversion: 2.1 time: 0.111982 Aug 24 16:40:42.365663 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 91/167] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:42 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:42.646637 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1dcb532e-111a-4d43-bae5-02e157647f5d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:42.648587 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1dcb532e-111a-4d43-bae5-02e157647f5d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:42.655769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1dcb532e-111a-4d43-bae5-02e157647f5d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:42.656571 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1dcb532e-111a-4d43-bae5-02e157647f5d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:42.657179 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1dcb532e-111a-4d43-bae5-02e157647f5d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:42.658036 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1dcb532e-111a-4d43-bae5-02e157647f5d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:42.658650 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1dcb532e-111a-4d43-bae5-02e157647f5d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:42.659227 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1dcb532e-111a-4d43-bae5-02e157647f5d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:43.301764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1dcb532e-111a-4d43-bae5-02e157647f5d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:43.311384 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:43.314929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1dcb532e-111a-4d43-bae5-02e157647f5d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.671085 Aug 24 16:40:43.328793 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 77/168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:42 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:43.394721 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-083af040-f71f-4da1-ac33-5dbaf358e570 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:43.395460 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-083af040-f71f-4da1-ac33-5dbaf358e570 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:43.407274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-083af040-f71f-4da1-ac33-5dbaf358e570 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:43.411527 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-083af040-f71f-4da1-ac33-5dbaf358e570 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:43.412245 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-083af040-f71f-4da1-ac33-5dbaf358e570 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:43.414058 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-083af040-f71f-4da1-ac33-5dbaf358e570 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:43.424623 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-083af040-f71f-4da1-ac33-5dbaf358e570 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:43.425391 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-083af040-f71f-4da1-ac33-5dbaf358e570 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:43.583390 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-083af040-f71f-4da1-ac33-5dbaf358e570 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:43.611488 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-083af040-f71f-4da1-ac33-5dbaf358e570 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1271 microversion: 2.1 time: 0.218501 Aug 24 16:40:43.615286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 92/169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:43 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:44.338522 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-05c7b621-0b3a-4b94-aec1-5a6698cd8791 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:44.339724 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-05c7b621-0b3a-4b94-aec1-5a6698cd8791 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:44.355527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-05c7b621-0b3a-4b94-aec1-5a6698cd8791 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:44.356696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-05c7b621-0b3a-4b94-aec1-5a6698cd8791 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:44.357589 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-05c7b621-0b3a-4b94-aec1-5a6698cd8791 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:44.360300 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-05c7b621-0b3a-4b94-aec1-5a6698cd8791 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:44.361425 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-05c7b621-0b3a-4b94-aec1-5a6698cd8791 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:44.362769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-05c7b621-0b3a-4b94-aec1-5a6698cd8791 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:44.638057 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e93e7ef0-9c1e-41f7-8117-3cd5ec3fe77d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:44.638643 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e93e7ef0-9c1e-41f7-8117-3cd5ec3fe77d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:44.649881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e93e7ef0-9c1e-41f7-8117-3cd5ec3fe77d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:44.650853 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e93e7ef0-9c1e-41f7-8117-3cd5ec3fe77d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:44.651459 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e93e7ef0-9c1e-41f7-8117-3cd5ec3fe77d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:44.652374 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e93e7ef0-9c1e-41f7-8117-3cd5ec3fe77d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:44.653037 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e93e7ef0-9c1e-41f7-8117-3cd5ec3fe77d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:44.654036 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e93e7ef0-9c1e-41f7-8117-3cd5ec3fe77d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:44.736099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-05c7b621-0b3a-4b94-aec1-5a6698cd8791 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:44.746131 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-05c7b621-0b3a-4b94-aec1-5a6698cd8791 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.412435 Aug 24 16:40:44.746821 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 78/170] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:44 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:44.987240 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e93e7ef0-9c1e-41f7-8117-3cd5ec3fe77d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:44.999220 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e93e7ef0-9c1e-41f7-8117-3cd5ec3fe77d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1313 microversion: 2.1 time: 0.365016 Aug 24 16:40:45.015117 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 93/171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:44 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:45.769967 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4eaa69d4-584c-4588-969e-3c0edaaf1b27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:45.770583 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4eaa69d4-584c-4588-969e-3c0edaaf1b27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:45.790397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4eaa69d4-584c-4588-969e-3c0edaaf1b27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:45.790895 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4eaa69d4-584c-4588-969e-3c0edaaf1b27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:45.791334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4eaa69d4-584c-4588-969e-3c0edaaf1b27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:45.792070 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4eaa69d4-584c-4588-969e-3c0edaaf1b27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:45.792530 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4eaa69d4-584c-4588-969e-3c0edaaf1b27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:45.792956 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4eaa69d4-584c-4588-969e-3c0edaaf1b27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:45.949005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1968978228", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452"}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:46.051929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] validate_networks() for None {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:40:46.486676 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4eaa69d4-584c-4588-969e-3c0edaaf1b27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:46.504779 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4eaa69d4-584c-4588-969e-3c0edaaf1b27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.740947 Aug 24 16:40:46.505672 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 79/172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:45 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:46.525985 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e551ac6a-a703-4ac9-b40d-389f508318eb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:46.530273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e551ac6a-a703-4ac9-b40d-389f508318eb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:46.539819 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e551ac6a-a703-4ac9-b40d-389f508318eb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:46.540445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e551ac6a-a703-4ac9-b40d-389f508318eb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:46.541413 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e551ac6a-a703-4ac9-b40d-389f508318eb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:46.542549 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e551ac6a-a703-4ac9-b40d-389f508318eb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:46.543254 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e551ac6a-a703-4ac9-b40d-389f508318eb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:46.544601 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e551ac6a-a703-4ac9-b40d-389f508318eb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:46.737997 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:40:46.739651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:40:46.740661 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:40:46.741286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:40:46.742404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:40:46.755632 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:46.756607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:46.757353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:46.758380 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:46.758979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:46.759695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:46.782214 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Getting quotas for project fe5a43a5024141fc9c9977086b245550. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:40:46.787229 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Getting quotas for user ee66b7c264dd44db887898923c925dc8 and project fe5a43a5024141fc9c9977086b245550. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:40:46.802707 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:40:46.805750 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:40:46.844116 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e551ac6a-a703-4ac9-b40d-389f508318eb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:46.854970 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e551ac6a-a703-4ac9-b40d-389f508318eb tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1313 microversion: 2.1 time: 0.347858 Aug 24 16:40:46.855550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 80/173] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:46 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:46.866214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-a93da794-e17f-417b-a5c3-f63cb71f80e7 req-87e4f83e-a14e-4195-baa8-63d2e895b9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe94398-f654-4256-95b8-63740f301052", "tag": "a1e459ed-3d0d-4dd7-a843-bbee7dc0af9a"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:46.888063 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-a93da794-e17f-417b-a5c3-f63cb71f80e7 req-87e4f83e-a14e-4195-baa8-63d2e895b9bd service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:46.888552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-a93da794-e17f-417b-a5c3-f63cb71f80e7 req-87e4f83e-a14e-4195-baa8-63d2e895b9bd service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:46.893498 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-a93da794-e17f-417b-a5c3-f63cb71f80e7 req-87e4f83e-a14e-4195-baa8-63d2e895b9bd service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:46.913140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3f032e66-6f75-4249-acb8-9838b636e215 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.967614 Aug 24 16:40:46.918280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-a93da794-e17f-417b-a5c3-f63cb71f80e7 req-87e4f83e-a14e-4195-baa8-63d2e895b9bd service nova] Creating event network-changed:a1e459ed-3d0d-4dd7-a843-bbee7dc0af9a for instance 5fe94398-f654-4256-95b8-63740f301052 on hv-cinder-77957 Aug 24 16:40:46.922299 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 94/174] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:40:46.932686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-a93da794-e17f-417b-a5c3-f63cb71f80e7 req-87e4f83e-a14e-4195-baa8-63d2e895b9bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069747 Aug 24 16:40:46.939499 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-43f60bf7-5897-45c1-b8f0-7be229bcd4e1 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:46.939685 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 81/175] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:46.940618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-43f60bf7-5897-45c1-b8f0-7be229bcd4e1 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:47.045248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-43f60bf7-5897-45c1-b8f0-7be229bcd4e1 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:47.066399 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-43f60bf7-5897-45c1-b8f0-7be229bcd4e1 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1215 microversion: 2.1 time: 0.139383 Aug 24 16:40:47.067030 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 95/176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:46 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:47.532322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-30c0b68f-e91e-4058-9948-8b56e6227d56 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:47.533132 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-30c0b68f-e91e-4058-9948-8b56e6227d56 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:47.546111 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-30c0b68f-e91e-4058-9948-8b56e6227d56 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:47.550583 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-30c0b68f-e91e-4058-9948-8b56e6227d56 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:47.551913 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-30c0b68f-e91e-4058-9948-8b56e6227d56 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:47.554112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-30c0b68f-e91e-4058-9948-8b56e6227d56 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:47.555032 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-30c0b68f-e91e-4058-9948-8b56e6227d56 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:47.555726 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-30c0b68f-e91e-4058-9948-8b56e6227d56 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:47.841909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-30c0b68f-e91e-4058-9948-8b56e6227d56 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:47.851171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-30c0b68f-e91e-4058-9948-8b56e6227d56 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.324323 Aug 24 16:40:47.853413 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 82/177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:47 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:47.879445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-eaa15cc6-b9f7-4b41-99bc-e3f40a5e3567 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:47.880138 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-eaa15cc6-b9f7-4b41-99bc-e3f40a5e3567 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:47.886688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaa15cc6-b9f7-4b41-99bc-e3f40a5e3567 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:47.887242 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaa15cc6-b9f7-4b41-99bc-e3f40a5e3567 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:47.887847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaa15cc6-b9f7-4b41-99bc-e3f40a5e3567 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:47.888902 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaa15cc6-b9f7-4b41-99bc-e3f40a5e3567 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:47.889567 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaa15cc6-b9f7-4b41-99bc-e3f40a5e3567 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:47.890079 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaa15cc6-b9f7-4b41-99bc-e3f40a5e3567 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:48.087286 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c81bf86b-f07f-43bb-8a6b-e254283f6798 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:48.087907 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c81bf86b-f07f-43bb-8a6b-e254283f6798 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:48.111077 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c81bf86b-f07f-43bb-8a6b-e254283f6798 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:48.113755 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c81bf86b-f07f-43bb-8a6b-e254283f6798 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:48.114407 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c81bf86b-f07f-43bb-8a6b-e254283f6798 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:48.117805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c81bf86b-f07f-43bb-8a6b-e254283f6798 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:48.118447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c81bf86b-f07f-43bb-8a6b-e254283f6798 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:48.119931 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c81bf86b-f07f-43bb-8a6b-e254283f6798 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:48.145587 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-eaa15cc6-b9f7-4b41-99bc-e3f40a5e3567 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:48.162334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-eaa15cc6-b9f7-4b41-99bc-e3f40a5e3567 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1313 microversion: 2.1 time: 0.284877 Aug 24 16:40:48.164181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 96/178] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:47 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:48.250798 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c81bf86b-f07f-43bb-8a6b-e254283f6798 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:48.263555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c81bf86b-f07f-43bb-8a6b-e254283f6798 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1211 microversion: 2.1 time: 0.178307 Aug 24 16:40:48.265036 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 83/179] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:48 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1211 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:48.876385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6c294012-2aed-4c4a-813d-abe25b09e0ac tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:48.877181 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6c294012-2aed-4c4a-813d-abe25b09e0ac tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:48.881304 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:48.889402 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c294012-2aed-4c4a-813d-abe25b09e0ac tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:48.890170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c294012-2aed-4c4a-813d-abe25b09e0ac tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:48.890806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c294012-2aed-4c4a-813d-abe25b09e0ac tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:48.900310 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c294012-2aed-4c4a-813d-abe25b09e0ac tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:48.903787 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c294012-2aed-4c4a-813d-abe25b09e0ac tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:48.905023 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6c294012-2aed-4c4a-813d-abe25b09e0ac tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:49.047215 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-74368515-a9da-4c0d-891b-d3670007a0dd tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Action: 'create', calling method: .version_select at 0x7f063b5a5ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1771394736"}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:49.453631 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6c294012-2aed-4c4a-813d-abe25b09e0ac tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:49.468290 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6c294012-2aed-4c4a-813d-abe25b09e0ac tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.597294 Aug 24 16:40:49.469357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 84/180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:48 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:49.475689 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-448e57a6-84b3-4df1-97d2-8b816bd49ec0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:49.476634 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-448e57a6-84b3-4df1-97d2-8b816bd49ec0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:49.495131 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-448e57a6-84b3-4df1-97d2-8b816bd49ec0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:49.496663 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-448e57a6-84b3-4df1-97d2-8b816bd49ec0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:49.497426 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-448e57a6-84b3-4df1-97d2-8b816bd49ec0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:49.499467 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-448e57a6-84b3-4df1-97d2-8b816bd49ec0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:49.500465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-448e57a6-84b3-4df1-97d2-8b816bd49ec0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:49.501161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-448e57a6-84b3-4df1-97d2-8b816bd49ec0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:49.676159 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-448e57a6-84b3-4df1-97d2-8b816bd49ec0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:49.689861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-448e57a6-84b3-4df1-97d2-8b816bd49ec0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1313 microversion: 2.1 time: 0.217458 Aug 24 16:40:49.705215 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 85/181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:49 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:49.724020 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-efa6a764-a9c0-433a-a1d7-26dfee161368 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:49.724870 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-efa6a764-a9c0-433a-a1d7-26dfee161368 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:49.741056 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-efa6a764-a9c0-433a-a1d7-26dfee161368 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:49.755879 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-efa6a764-a9c0-433a-a1d7-26dfee161368 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:49.757528 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-efa6a764-a9c0-433a-a1d7-26dfee161368 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:49.758464 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-efa6a764-a9c0-433a-a1d7-26dfee161368 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:49.759745 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-efa6a764-a9c0-433a-a1d7-26dfee161368 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:49.761831 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-efa6a764-a9c0-433a-a1d7-26dfee161368 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:49.795692 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-74368515-a9da-4c0d-891b-d3670007a0dd tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.222505 Aug 24 16:40:49.800115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 97/182] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Aug 24 16:40:48 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1225 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 16:40:49.812640 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b4c18378-af58-4633-a8e2-d9bad1ec39d6 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063b541940>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:49.911016 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b4c18378-af58-4633-a8e2-d9bad1ec39d6 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1" status: 200 len: 345 microversion: 2.1 time: 0.102853 Aug 24 16:40:49.912901 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 98/183] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:40:49 2022] GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1 => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:49.918009 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-efa6a764-a9c0-433a-a1d7-26dfee161368 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:49.929462 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-efa6a764-a9c0-433a-a1d7-26dfee161368 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1273 microversion: 2.1 time: 0.220671 Aug 24 16:40:49.930353 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 86/184] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:49 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:50.491727 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1f971e65-1d60-4878-8b11-cfa922e204d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:50.492930 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1f971e65-1d60-4878-8b11-cfa922e204d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:50.518564 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f971e65-1d60-4878-8b11-cfa922e204d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:50.519156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f971e65-1d60-4878-8b11-cfa922e204d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:50.519673 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f971e65-1d60-4878-8b11-cfa922e204d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:50.520559 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f971e65-1d60-4878-8b11-cfa922e204d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:50.521024 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f971e65-1d60-4878-8b11-cfa922e204d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:50.521456 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f971e65-1d60-4878-8b11-cfa922e204d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:50.716362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-70613dc8-18c7-4d06-b847-8c4e6e4f3be4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:50.717514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-70613dc8-18c7-4d06-b847-8c4e6e4f3be4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:50.721403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1f971e65-1d60-4878-8b11-cfa922e204d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:50.729219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-70613dc8-18c7-4d06-b847-8c4e6e4f3be4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:50.729719 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-70613dc8-18c7-4d06-b847-8c4e6e4f3be4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:50.730163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-70613dc8-18c7-4d06-b847-8c4e6e4f3be4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:50.730691 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1f971e65-1d60-4878-8b11-cfa922e204d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.244148 Aug 24 16:40:50.730869 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-70613dc8-18c7-4d06-b847-8c4e6e4f3be4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:50.731328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-70613dc8-18c7-4d06-b847-8c4e6e4f3be4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:50.732064 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 99/185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:50 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:50.734081 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-70613dc8-18c7-4d06-b847-8c4e6e4f3be4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:50.829576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:50.878620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=6 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:50.914977 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-70613dc8-18c7-4d06-b847-8c4e6e4f3be4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:50.923731 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-70613dc8-18c7-4d06-b847-8c4e6e4f3be4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1313 microversion: 2.1 time: 0.211091 Aug 24 16:40:50.926016 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-45938988-3903-4fb4-8371-b03b56bdf5d3 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063b5a5af0>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:50.929838 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 87/186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:50 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:50.952935 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-75b1e80c-3d5d-4690-9aa4-8d64c40b18be tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:50.953777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-75b1e80c-3d5d-4690-9aa4-8d64c40b18be tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:50.961288 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-75b1e80c-3d5d-4690-9aa4-8d64c40b18be tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:50.962519 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-75b1e80c-3d5d-4690-9aa4-8d64c40b18be tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:50.963214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-75b1e80c-3d5d-4690-9aa4-8d64c40b18be tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:50.964168 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-75b1e80c-3d5d-4690-9aa4-8d64c40b18be tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:50.964777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-75b1e80c-3d5d-4690-9aa4-8d64c40b18be tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:50.965399 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-75b1e80c-3d5d-4690-9aa4-8d64c40b18be tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:51.030834 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-45938988-3903-4fb4-8371-b03b56bdf5d3 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1" status: 200 len: 346 microversion: 2.1 time: 0.109513 Aug 24 16:40:51.031545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 100/187] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:40:50 2022] GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1 => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:40:51.045564 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-507ef88d-6685-4c1c-bd6b-8b707ec90fe6 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Action: 'create', calling method: .version_select at 0x7f063b541b80>, body: {"snapshot": {"volume_id": "a62f33a2-b9e4-4822-a490-7a5535d6e1f1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1085475895"}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:51.215738 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-75b1e80c-3d5d-4690-9aa4-8d64c40b18be tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:51.242511 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-75b1e80c-3d5d-4690-9aa4-8d64c40b18be tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1315 microversion: 2.1 time: 0.294999 Aug 24 16:40:51.250755 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 88/188] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:50 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:51.279585 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-b4925462-62d0-412d-9583-933cc786caaa req-bbb6c545-4b27-4ebc-a402-3c41f269926c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4551440e-1d3e-4404-9a61-63b551cddffa", "tag": "07821013-da31-466e-a603-2a5751f770ae"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:51.296574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-b4925462-62d0-412d-9583-933cc786caaa req-bbb6c545-4b27-4ebc-a402-3c41f269926c service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:51.297337 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-b4925462-62d0-412d-9583-933cc786caaa req-bbb6c545-4b27-4ebc-a402-3c41f269926c service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:51.299125 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-b4925462-62d0-412d-9583-933cc786caaa req-bbb6c545-4b27-4ebc-a402-3c41f269926c service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:51.317362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-b4925462-62d0-412d-9583-933cc786caaa req-bbb6c545-4b27-4ebc-a402-3c41f269926c service nova] Creating event network-changed:07821013-da31-466e-a603-2a5751f770ae for instance 4551440e-1d3e-4404-9a61-63b551cddffa on hv-cinder-77957 Aug 24 16:40:51.324701 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-b4925462-62d0-412d-9583-933cc786caaa req-bbb6c545-4b27-4ebc-a402-3c41f269926c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071912 Aug 24 16:40:51.325675 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 89/189] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:51.346560 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-507ef88d-6685-4c1c-bd6b-8b707ec90fe6 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.305874 Aug 24 16:40:51.348425 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 101/190] 10.222.0.52 () {60 vars in 1162 bytes} [Wed Aug 24 16:40:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:40:51.359716 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a693e4a6-0678-41ab-b941-76c43b938410 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063ac63f70>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:51.431484 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a693e4a6-0678-41ab-b941-76c43b938410 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1" status: 200 len: 287 microversion: 2.1 time: 0.076308 Aug 24 16:40:51.432078 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 90/191] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 16:40:51 2022] GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:51.444550 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-194d8978-e57d-4fe7-81f3-b89b9aa126bb tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063b54e0d0>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:51.493451 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-194d8978-e57d-4fe7-81f3-b89b9aa126bb tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.053917 Aug 24 16:40:51.494042 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 102/192] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Aug 24 16:40:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:51.505298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1bcf5e2c-dac1-4ca1-8a30-40c82cbf811e tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063ae5f820>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:51.542188 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1bcf5e2c-dac1-4ca1-8a30-40c82cbf811e tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1" status: 200 len: 287 microversion: 2.1 time: 0.040722 Aug 24 16:40:51.544163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 91/193] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 16:40:51 2022] GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:51.762909 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5e0bb87a-a230-46a3-bd4b-444e44d73513 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:51.766096 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5e0bb87a-a230-46a3-bd4b-444e44d73513 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:51.794028 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e0bb87a-a230-46a3-bd4b-444e44d73513 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:51.794870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e0bb87a-a230-46a3-bd4b-444e44d73513 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:51.796174 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e0bb87a-a230-46a3-bd4b-444e44d73513 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:51.798171 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e0bb87a-a230-46a3-bd4b-444e44d73513 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:51.798632 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e0bb87a-a230-46a3-bd4b-444e44d73513 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:51.799078 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e0bb87a-a230-46a3-bd4b-444e44d73513 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:51.893384 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-28705ddc-c3f8-4a30-941b-ef87244b6ffb req-739a1ed6-d588-4d63-99b1-19f9bfb8c724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe94398-f654-4256-95b8-63740f301052", "name": "network-vif-plugged", "status": "completed", "tag": "a1e459ed-3d0d-4dd7-a843-bbee7dc0af9a"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:40:51.909065 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-28705ddc-c3f8-4a30-941b-ef87244b6ffb req-739a1ed6-d588-4d63-99b1-19f9bfb8c724 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:51.910697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-28705ddc-c3f8-4a30-941b-ef87244b6ffb req-739a1ed6-d588-4d63-99b1-19f9bfb8c724 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:51.911317 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-28705ddc-c3f8-4a30-941b-ef87244b6ffb req-739a1ed6-d588-4d63-99b1-19f9bfb8c724 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:51.930045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-28705ddc-c3f8-4a30-941b-ef87244b6ffb req-739a1ed6-d588-4d63-99b1-19f9bfb8c724 service nova] Creating event network-vif-plugged:a1e459ed-3d0d-4dd7-a843-bbee7dc0af9a for instance 5fe94398-f654-4256-95b8-63740f301052 on hv-cinder-77957 Aug 24 16:40:51.936114 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-28705ddc-c3f8-4a30-941b-ef87244b6ffb req-739a1ed6-d588-4d63-99b1-19f9bfb8c724 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048041 Aug 24 16:40:51.937159 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 92/194] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:40:51.947270 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e1225b63-832c-4b5d-b624-34375b3f7242 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:51.948922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e1225b63-832c-4b5d-b624-34375b3f7242 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:51.957305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e1225b63-832c-4b5d-b624-34375b3f7242 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:51.957798 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e1225b63-832c-4b5d-b624-34375b3f7242 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:51.958345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e1225b63-832c-4b5d-b624-34375b3f7242 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:51.959094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e1225b63-832c-4b5d-b624-34375b3f7242 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:51.959554 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e1225b63-832c-4b5d-b624-34375b3f7242 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:51.959998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e1225b63-832c-4b5d-b624-34375b3f7242 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:52.000544 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5e0bb87a-a230-46a3-bd4b-444e44d73513 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:52.012762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5e0bb87a-a230-46a3-bd4b-444e44d73513 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.262871 Aug 24 16:40:52.013699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 103/195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:51 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:52.118402 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e1225b63-832c-4b5d-b624-34375b3f7242 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:52.125960 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e1225b63-832c-4b5d-b624-34375b3f7242 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1313 microversion: 2.1 time: 0.183161 Aug 24 16:40:52.126519 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 93/196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:51 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:52.273607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-86ad1463-bf39-4ecd-9e04-22253a68ba57 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:52.274414 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-86ad1463-bf39-4ecd-9e04-22253a68ba57 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:52.281669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86ad1463-bf39-4ecd-9e04-22253a68ba57 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:52.282310 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86ad1463-bf39-4ecd-9e04-22253a68ba57 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:52.282856 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86ad1463-bf39-4ecd-9e04-22253a68ba57 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:52.283905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86ad1463-bf39-4ecd-9e04-22253a68ba57 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:52.284677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86ad1463-bf39-4ecd-9e04-22253a68ba57 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:52.285384 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86ad1463-bf39-4ecd-9e04-22253a68ba57 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:52.418945 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-86ad1463-bf39-4ecd-9e04-22253a68ba57 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:52.427231 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-86ad1463-bf39-4ecd-9e04-22253a68ba57 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1315 microversion: 2.1 time: 0.158812 Aug 24 16:40:52.428454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 104/197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:52 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:52.555793 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8a5691c2-8d18-4949-ad17-548ef4abc042 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063af1cdc0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:52.589936 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8a5691c2-8d18-4949-ad17-548ef4abc042 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1" status: 200 len: 287 microversion: 2.1 time: 0.037946 Aug 24 16:40:52.590512 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 94/198] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 16:40:52 2022] GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:40:53.033472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b1acab68-5261-4299-805e-06d94da60b69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:53.034116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b1acab68-5261-4299-805e-06d94da60b69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:53.040860 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1acab68-5261-4299-805e-06d94da60b69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:53.041350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1acab68-5261-4299-805e-06d94da60b69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:53.041793 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1acab68-5261-4299-805e-06d94da60b69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:53.042492 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1acab68-5261-4299-805e-06d94da60b69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:53.042983 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1acab68-5261-4299-805e-06d94da60b69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:53.043442 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1acab68-5261-4299-805e-06d94da60b69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:53.058021 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=100 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:53.148823 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-11ad65f3-c265-4b15-870b-3185d0d4f25a tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:53.149431 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-11ad65f3-c265-4b15-870b-3185d0d4f25a tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:53.155614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-11ad65f3-c265-4b15-870b-3185d0d4f25a tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:53.156134 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-11ad65f3-c265-4b15-870b-3185d0d4f25a tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:53.156566 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-11ad65f3-c265-4b15-870b-3185d0d4f25a tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:53.157251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-11ad65f3-c265-4b15-870b-3185d0d4f25a tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:53.157700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-11ad65f3-c265-4b15-870b-3185d0d4f25a tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:53.158120 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-11ad65f3-c265-4b15-870b-3185d0d4f25a tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:53.170316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b1acab68-5261-4299-805e-06d94da60b69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:53.177974 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b1acab68-5261-4299-805e-06d94da60b69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.148330 Aug 24 16:40:53.178543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 105/199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:53 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:53.294882 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-11ad65f3-c265-4b15-870b-3185d0d4f25a tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:53.302924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-11ad65f3-c265-4b15-870b-3185d0d4f25a tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1313 microversion: 2.1 time: 0.159431 Aug 24 16:40:53.303489 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 95/200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:53 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:53.449236 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b8ae5ada-17da-4dbd-ae42-90a83b83d4ce tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:53.449973 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b8ae5ada-17da-4dbd-ae42-90a83b83d4ce tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:53.455800 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b8ae5ada-17da-4dbd-ae42-90a83b83d4ce tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:53.456883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b8ae5ada-17da-4dbd-ae42-90a83b83d4ce tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:53.457471 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b8ae5ada-17da-4dbd-ae42-90a83b83d4ce tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:53.458171 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b8ae5ada-17da-4dbd-ae42-90a83b83d4ce tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:53.458627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b8ae5ada-17da-4dbd-ae42-90a83b83d4ce tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:53.459057 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b8ae5ada-17da-4dbd-ae42-90a83b83d4ce tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:53.600501 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b8ae5ada-17da-4dbd-ae42-90a83b83d4ce tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:53.602624 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ff1c8fc0-c430-4abd-8710-d48f526e19d3 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063ac45790>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:53.608425 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b8ae5ada-17da-4dbd-ae42-90a83b83d4ce tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1315 microversion: 2.1 time: 0.163018 Aug 24 16:40:53.608998 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 106/201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:53 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:53.633081 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ff1c8fc0-c430-4abd-8710-d48f526e19d3 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1" status: 200 len: 287 microversion: 2.1 time: 0.034139 Aug 24 16:40:53.633646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 96/202] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 16:40:53 2022] GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:40:54.198540 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-424d8f13-9dda-4718-80d5-64fd809d5e47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:54.199176 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-424d8f13-9dda-4718-80d5-64fd809d5e47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:54.205086 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-424d8f13-9dda-4718-80d5-64fd809d5e47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:54.205570 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-424d8f13-9dda-4718-80d5-64fd809d5e47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:54.206015 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-424d8f13-9dda-4718-80d5-64fd809d5e47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:54.206831 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-424d8f13-9dda-4718-80d5-64fd809d5e47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:54.207288 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-424d8f13-9dda-4718-80d5-64fd809d5e47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:54.207715 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-424d8f13-9dda-4718-80d5-64fd809d5e47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:54.324517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a3ec7bf9-d0ad-44bb-8bc4-8ee492c3fc6b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:54.325128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a3ec7bf9-d0ad-44bb-8bc4-8ee492c3fc6b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:54.332147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a3ec7bf9-d0ad-44bb-8bc4-8ee492c3fc6b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:54.333066 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a3ec7bf9-d0ad-44bb-8bc4-8ee492c3fc6b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:54.333498 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a3ec7bf9-d0ad-44bb-8bc4-8ee492c3fc6b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:54.334199 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a3ec7bf9-d0ad-44bb-8bc4-8ee492c3fc6b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:54.334654 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a3ec7bf9-d0ad-44bb-8bc4-8ee492c3fc6b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:54.335070 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a3ec7bf9-d0ad-44bb-8bc4-8ee492c3fc6b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:54.348899 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-424d8f13-9dda-4718-80d5-64fd809d5e47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:54.356657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-424d8f13-9dda-4718-80d5-64fd809d5e47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.161963 Aug 24 16:40:54.357231 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 107/203] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:54 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:54.483404 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a3ec7bf9-d0ad-44bb-8bc4-8ee492c3fc6b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:54.491835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a3ec7bf9-d0ad-44bb-8bc4-8ee492c3fc6b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1313 microversion: 2.1 time: 0.171721 Aug 24 16:40:54.492435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 97/204] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:54 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:54.630584 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1e35a924-f034-413a-92e7-9d2de478b909 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:54.631304 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1e35a924-f034-413a-92e7-9d2de478b909 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:54.637247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1e35a924-f034-413a-92e7-9d2de478b909 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:54.637737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1e35a924-f034-413a-92e7-9d2de478b909 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:54.638178 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1e35a924-f034-413a-92e7-9d2de478b909 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:54.639035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1e35a924-f034-413a-92e7-9d2de478b909 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:54.639578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1e35a924-f034-413a-92e7-9d2de478b909 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:54.640106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1e35a924-f034-413a-92e7-9d2de478b909 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:54.645082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1c292d43-3de6-4074-9876-a085a4ffcdf6 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063adfc4c0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:54.680546 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1c292d43-3de6-4074-9876-a085a4ffcdf6 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1" status: 200 len: 288 microversion: 2.1 time: 0.039577 Aug 24 16:40:54.681110 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 98/205] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 16:40:54 2022] GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:54.693311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-703042c0-decc-4323-849a-3d1b053ecdca tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063ac63af0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:54.772349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-703042c0-decc-4323-849a-3d1b053ecdca tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1" status: 202 len: 0 microversion: 2.1 time: 0.083400 Aug 24 16:40:54.773207 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 99/206] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Aug 24 16:40:54 2022] DELETE /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:40:54.782448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7a91a680-ca4f-44f1-a4d1-6d9f7db0fbce tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063ac63550>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:54.786202 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1e35a924-f034-413a-92e7-9d2de478b909 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:54.794442 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1e35a924-f034-413a-92e7-9d2de478b909 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1315 microversion: 2.1 time: 0.168348 Aug 24 16:40:54.795093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 108/207] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:54 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:54.814263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7a91a680-ca4f-44f1-a4d1-6d9f7db0fbce tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1" status: 200 len: 287 microversion: 2.1 time: 0.035832 Aug 24 16:40:54.814903 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 100/208] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 16:40:54 2022] GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:55.381057 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f723be7f-f276-4f95-aec3-85bf46e40e2e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:55.381676 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f723be7f-f276-4f95-aec3-85bf46e40e2e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:55.395754 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f723be7f-f276-4f95-aec3-85bf46e40e2e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:55.396333 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f723be7f-f276-4f95-aec3-85bf46e40e2e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:55.397064 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f723be7f-f276-4f95-aec3-85bf46e40e2e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:55.397936 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f723be7f-f276-4f95-aec3-85bf46e40e2e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:55.398528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f723be7f-f276-4f95-aec3-85bf46e40e2e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:55.399779 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f723be7f-f276-4f95-aec3-85bf46e40e2e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:55.513542 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a6719bd5-9fd7-47c8-b004-97b5ab099d4b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:55.514148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a6719bd5-9fd7-47c8-b004-97b5ab099d4b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:55.521599 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a6719bd5-9fd7-47c8-b004-97b5ab099d4b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:55.522390 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a6719bd5-9fd7-47c8-b004-97b5ab099d4b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:55.523013 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a6719bd5-9fd7-47c8-b004-97b5ab099d4b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:55.524540 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a6719bd5-9fd7-47c8-b004-97b5ab099d4b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:55.525247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a6719bd5-9fd7-47c8-b004-97b5ab099d4b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:55.525917 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a6719bd5-9fd7-47c8-b004-97b5ab099d4b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:55.734390 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f723be7f-f276-4f95-aec3-85bf46e40e2e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:55.749269 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f723be7f-f276-4f95-aec3-85bf46e40e2e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.373014 Aug 24 16:40:55.750050 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 109/209] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:55 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:55.806281 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a6719bd5-9fd7-47c8-b004-97b5ab099d4b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:55.814664 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c679c82a-a7ef-4c1b-b91f-60d88fb92c23 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:55.815277 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c679c82a-a7ef-4c1b-b91f-60d88fb92c23 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:55.819325 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a6719bd5-9fd7-47c8-b004-97b5ab099d4b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1313 microversion: 2.1 time: 0.309963 Aug 24 16:40:55.819897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 101/210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:55 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:55.821931 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c679c82a-a7ef-4c1b-b91f-60d88fb92c23 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:55.822424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c679c82a-a7ef-4c1b-b91f-60d88fb92c23 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:55.822861 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c679c82a-a7ef-4c1b-b91f-60d88fb92c23 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:55.823560 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c679c82a-a7ef-4c1b-b91f-60d88fb92c23 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:55.824160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c679c82a-a7ef-4c1b-b91f-60d88fb92c23 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:55.824589 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c679c82a-a7ef-4c1b-b91f-60d88fb92c23 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:55.827174 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7f8060c4-815e-4ab0-9cbd-4ab93cf75622 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063ac71b80>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:55.856506 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-7f8060c4-815e-4ab0-9cbd-4ab93cf75622 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] HTTP exception thrown: Snapshot e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 could not be found. Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7f8060c4-815e-4ab0-9cbd-4ab93cf75622 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Request method failure captured: Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 HTTP/1.1 Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlSQ7txcEV2v-RNO51j63KxBkezOhZRKnNP23lb6rfuJjKEES92zA-C7ley5KvrZ930nfXMj23PaxxCDnshpCqEtIqBKnS-Tt3s77F34gsNQCXGAnQQgof2o_KDjjQLDiUpXdbCbOJwUGWJPjAAE0cF5X484AGfFxOu9EnAE9Z9TmAc Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 2a422dfab790479db363b57365d16320 Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:40:55.860024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a422dfab790479db363b57365d16320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a422dfab790479db363b57365d16320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a422dfab790479db363b57365d16320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a422dfab790479db363b57365d16320", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 2a422dfab790479db363b57365d16320 Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-VolumesSnapshotsTestJSON-2118385102-project Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 3b44aa2ad6c7432fa333613cbd5bfc96 Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2118385102-project Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Snapshot e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 could not be found. Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'e3f079e5-8a35-47e3-99ca-506d5d2b3bc1'} Aug 24 16:40:55.861527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 could not be found. (HTTP 404) (Request-ID: req-29d8ff4d-def3-4e2a-9f44-215b6f317c2d) Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:55.862420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:40:55.863896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 could not be found. Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 16:40:55.864945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 could not be found. Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 could not be found. Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7f8060c4-815e-4ab0-9cbd-4ab93cf75622 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Returning 404 to user: Snapshot e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:40:55.866042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7f8060c4-815e-4ab0-9cbd-4ab93cf75622 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1" status: 404 len: 111 microversion: 2.1 time: 0.038423 Aug 24 16:40:55.867162 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 102/211] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 16:40:55 2022] GET /compute/v2.1/os-snapshots/e3f079e5-8a35-47e3-99ca-506d5d2b3bc1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:40:55.870507 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e047437e-afc7-4fc3-941b-58101e5908e3 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063ac02550>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:55.946897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e047437e-afc7-4fc3-941b-58101e5908e3 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1" status: 202 len: 0 microversion: 2.1 time: 0.080329 Aug 24 16:40:55.950888 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 103/212] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 16:40:55 2022] DELETE /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 16:40:55.964601 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d921b200-d80f-406d-8a29-d390884d337e tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063aca38b0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:56.031202 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d921b200-d80f-406d-8a29-d390884d337e tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1" status: 200 len: 345 microversion: 2.1 time: 0.078848 Aug 24 16:40:56.032634 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 104/213] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:40:55 2022] GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:40:56.072655 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c679c82a-a7ef-4c1b-b91f-60d88fb92c23 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:56.088586 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c679c82a-a7ef-4c1b-b91f-60d88fb92c23 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1315 microversion: 2.1 time: 0.276253 Aug 24 16:40:56.092689 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 110/214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:55 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:56.772423 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-093cbbb6-158d-464b-bbf3-2137d580fb28 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:56.773037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-093cbbb6-158d-464b-bbf3-2137d580fb28 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:56.779629 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-093cbbb6-158d-464b-bbf3-2137d580fb28 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:56.780202 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-093cbbb6-158d-464b-bbf3-2137d580fb28 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:56.780860 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-093cbbb6-158d-464b-bbf3-2137d580fb28 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:56.781714 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-093cbbb6-158d-464b-bbf3-2137d580fb28 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:56.782171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-093cbbb6-158d-464b-bbf3-2137d580fb28 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:56.782711 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-093cbbb6-158d-464b-bbf3-2137d580fb28 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:56.841402 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:56.847886 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dbb05b1e-0205-4b25-b953-9bbb7e7a88ad tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:56.849009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-dbb05b1e-0205-4b25-b953-9bbb7e7a88ad tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:56.851810 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:56.858009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbb05b1e-0205-4b25-b953-9bbb7e7a88ad tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:56.858009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbb05b1e-0205-4b25-b953-9bbb7e7a88ad tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:56.858422 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbb05b1e-0205-4b25-b953-9bbb7e7a88ad tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:56.859134 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbb05b1e-0205-4b25-b953-9bbb7e7a88ad tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:56.859604 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbb05b1e-0205-4b25-b953-9bbb7e7a88ad tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:56.860485 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dbb05b1e-0205-4b25-b953-9bbb7e7a88ad tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:57.050302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=10 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:57.053050 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-093cbbb6-158d-464b-bbf3-2137d580fb28 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:57.062099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-093cbbb6-158d-464b-bbf3-2137d580fb28 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.295782 Aug 24 16:40:57.062792 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 105/215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:56 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:57.070129 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0c297563-11d1-442e-ae21-8ed10f68ec21 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063aca3dc0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:57.094815 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-dbb05b1e-0205-4b25-b953-9bbb7e7a88ad tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:57.104891 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-dbb05b1e-0205-4b25-b953-9bbb7e7a88ad tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1313 microversion: 2.1 time: 0.265483 Aug 24 16:40:57.106035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 111/216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:56 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:57.107617 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-0c297563-11d1-442e-ae21-8ed10f68ec21 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] HTTP exception thrown: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0c297563-11d1-442e-ae21-8ed10f68ec21 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Request method failure captured: Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1 HTTP/1.1 Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlSQ7txcEV2v-RNO51j63KxBkezOhZRKnNP23lb6rfuJjKEES92zA-C7ley5KvrZ930nfXMj23PaxxCDnshpCqEtIqBKnS-Tt3s77F34gsNQCXGAnQQgof2o_KDjjQLDiUpXdbCbOJwUGWJPjAAE0cF5X484AGfFxOu9EnAE9Z9TmAc Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 2a422dfab790479db363b57365d16320 Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:40:57.110783 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a422dfab790479db363b57365d16320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a422dfab790479db363b57365d16320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a422dfab790479db363b57365d16320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a422dfab790479db363b57365d16320", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 2a422dfab790479db363b57365d16320 Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-VolumesSnapshotsTestJSON-2118385102-project Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 3b44aa2ad6c7432fa333613cbd5bfc96 Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2118385102-project Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'a62f33a2-b9e4-4822-a490-7a5535d6e1f1'} Aug 24 16:40:57.111909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. (HTTP 404) (Request-ID: req-f9c3af70-1c31-4ab1-9b14-d71920f3c1ce) Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:57.112929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:40:57.114148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:40:57.115208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0c297563-11d1-442e-ae21-8ed10f68ec21 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Returning 404 to user: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0c297563-11d1-442e-ae21-8ed10f68ec21 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1" status: 404 len: 109 microversion: 2.1 time: 0.047167 Aug 24 16:40:57.117195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 106/217] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:40:57 2022] GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:40:57.124255 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6ec6a0d4-5a0b-41cd-9cde-749d207eb24f tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:57.124811 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6ec6a0d4-5a0b-41cd-9cde-749d207eb24f tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:57.125584 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0d53fe5e-4d8e-454c-a796-a4da82e029ba tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063ae5f0d0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:57.132438 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6ec6a0d4-5a0b-41cd-9cde-749d207eb24f tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:57.132582 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6ec6a0d4-5a0b-41cd-9cde-749d207eb24f tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:57.133061 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6ec6a0d4-5a0b-41cd-9cde-749d207eb24f tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:57.133818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6ec6a0d4-5a0b-41cd-9cde-749d207eb24f tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:57.135061 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6ec6a0d4-5a0b-41cd-9cde-749d207eb24f tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:57.135590 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6ec6a0d4-5a0b-41cd-9cde-749d207eb24f tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:57.158134 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-0d53fe5e-4d8e-454c-a796-a4da82e029ba tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] HTTP exception thrown: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0d53fe5e-4d8e-454c-a796-a4da82e029ba tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Request method failure captured: Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: DELETE /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1 HTTP/1.1 Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlSQ7txcEV2v-RNO51j63KxBkezOhZRKnNP23lb6rfuJjKEES92zA-C7ley5KvrZ930nfXMj23PaxxCDnshpCqEtIqBKnS-Tt3s77F34gsNQCXGAnQQgof2o_KDjjQLDiUpXdbCbOJwUGWJPjAAE0cF5X484AGfFxOu9EnAE9Z9TmAc Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 2a422dfab790479db363b57365d16320 Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:40:57.160225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a422dfab790479db363b57365d16320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a422dfab790479db363b57365d16320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a422dfab790479db363b57365d16320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a422dfab790479db363b57365d16320", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 2a422dfab790479db363b57365d16320 Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-VolumesSnapshotsTestJSON-2118385102-project Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 3b44aa2ad6c7432fa333613cbd5bfc96 Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2118385102-project Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'a62f33a2-b9e4-4822-a490-7a5535d6e1f1'} Aug 24 16:40:57.161440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. (HTTP 404) (Request-ID: req-799b86ba-eae6-4b0c-92af-22b7dd1968c1) Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:57.162133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 16:40:57.163143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 16:40:57.164178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0d53fe5e-4d8e-454c-a796-a4da82e029ba tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Returning 404 to user: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0d53fe5e-4d8e-454c-a796-a4da82e029ba tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1" status: 404 len: 109 microversion: 2.1 time: 0.039661 Aug 24 16:40:57.165138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 107/218] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 16:40:57 2022] DELETE /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:40:57.171996 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-692cb076-ff71-4588-ad6d-f3f8e8c4d101 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Calling method '.version_select at 0x7f063aca3e50>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:57.201721 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-692cb076-ff71-4588-ad6d-f3f8e8c4d101 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] HTTP exception thrown: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-692cb076-ff71-4588-ad6d-f3f8e8c4d101 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Request method failure captured: Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1 HTTP/1.1 Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlSQ7txcEV2v-RNO51j63KxBkezOhZRKnNP23lb6rfuJjKEES92zA-C7ley5KvrZ930nfXMj23PaxxCDnshpCqEtIqBKnS-Tt3s77F34gsNQCXGAnQQgof2o_KDjjQLDiUpXdbCbOJwUGWJPjAAE0cF5X484AGfFxOu9EnAE9Z9TmAc Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 2a422dfab790479db363b57365d16320 Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:40:57.204112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a422dfab790479db363b57365d16320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a422dfab790479db363b57365d16320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a422dfab790479db363b57365d16320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a422dfab790479db363b57365d16320", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 2a422dfab790479db363b57365d16320 Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2118385102 Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-VolumesSnapshotsTestJSON-2118385102-project Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 3b44aa2ad6c7432fa333613cbd5bfc96 Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2118385102-project Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'a62f33a2-b9e4-4822-a490-7a5535d6e1f1'} Aug 24 16:40:57.205276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. (HTTP 404) (Request-ID: req-93e79829-c973-49c3-90e2-37847f7aa456) Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:57.206736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 16:40:57.208142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 16:40:57.209383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-692cb076-ff71-4588-ad6d-f3f8e8c4d101 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] Returning 404 to user: Volume a62f33a2-b9e4-4822-a490-7a5535d6e1f1 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-692cb076-ff71-4588-ad6d-f3f8e8c4d101 tempest-VolumesSnapshotsTestJSON-2118385102 tempest-VolumesSnapshotsTestJSON-2118385102-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1" status: 404 len: 109 microversion: 2.1 time: 0.037417 Aug 24 16:40:57.210638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 108/219] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 16:40:57 2022] GET /compute/v2.1/os-volumes/a62f33a2-b9e4-4822-a490-7a5535d6e1f1 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:40:57.296737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6ec6a0d4-5a0b-41cd-9cde-749d207eb24f tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:57.306204 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6ec6a0d4-5a0b-41cd-9cde-749d207eb24f tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1315 microversion: 2.1 time: 0.185529 Aug 24 16:40:57.306988 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 112/220] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:57 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:58.085418 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-32ac8508-9e91-47d5-912a-c0ad19434a69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:58.087276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-32ac8508-9e91-47d5-912a-c0ad19434a69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:58.095798 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32ac8508-9e91-47d5-912a-c0ad19434a69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:58.096611 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32ac8508-9e91-47d5-912a-c0ad19434a69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:58.097629 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32ac8508-9e91-47d5-912a-c0ad19434a69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:58.111664 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32ac8508-9e91-47d5-912a-c0ad19434a69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:58.113034 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32ac8508-9e91-47d5-912a-c0ad19434a69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:58.113695 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-32ac8508-9e91-47d5-912a-c0ad19434a69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:58.126610 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ce6bf370-9ce9-4472-9b79-a261f95adb41 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:58.127875 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ce6bf370-9ce9-4472-9b79-a261f95adb41 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:58.134925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=100 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:58.138074 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ce6bf370-9ce9-4472-9b79-a261f95adb41 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:58.138945 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ce6bf370-9ce9-4472-9b79-a261f95adb41 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:58.139616 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ce6bf370-9ce9-4472-9b79-a261f95adb41 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:58.140799 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ce6bf370-9ce9-4472-9b79-a261f95adb41 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:58.141636 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ce6bf370-9ce9-4472-9b79-a261f95adb41 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:58.142290 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ce6bf370-9ce9-4472-9b79-a261f95adb41 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:58.335544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-32ac8508-9e91-47d5-912a-c0ad19434a69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:58.343898 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-32ac8508-9e91-47d5-912a-c0ad19434a69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.265173 Aug 24 16:40:58.351747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 109/221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:58 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:58.363137 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1ce771d7-0cac-40ff-a366-437d431ff447 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:58.364096 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1ce771d7-0cac-40ff-a366-437d431ff447 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:58.370116 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1ce771d7-0cac-40ff-a366-437d431ff447 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:58.371204 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1ce771d7-0cac-40ff-a366-437d431ff447 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:58.372219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1ce771d7-0cac-40ff-a366-437d431ff447 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:58.373427 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1ce771d7-0cac-40ff-a366-437d431ff447 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:58.374077 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1ce771d7-0cac-40ff-a366-437d431ff447 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:58.374690 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1ce771d7-0cac-40ff-a366-437d431ff447 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:58.413228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ce6bf370-9ce9-4472-9b79-a261f95adb41 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:58.424167 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ce6bf370-9ce9-4472-9b79-a261f95adb41 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1498 microversion: 2.1 time: 0.299045 Aug 24 16:40:58.440046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 113/222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:58 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1498 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:58.541312 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1ce771d7-0cac-40ff-a366-437d431ff447 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:58.549341 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1ce771d7-0cac-40ff-a366-437d431ff447 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1315 microversion: 2.1 time: 0.196035 Aug 24 16:40:58.550067 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 110/223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:58 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:59.010348 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b9f2b66a-c6c8-4059-becb-cebbe1656eb7 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:59.010937 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b9f2b66a-c6c8-4059-becb-cebbe1656eb7 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:59.021779 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b9f2b66a-c6c8-4059-becb-cebbe1656eb7 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:59.021779 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b9f2b66a-c6c8-4059-becb-cebbe1656eb7 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:59.022188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b9f2b66a-c6c8-4059-becb-cebbe1656eb7 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:59.023580 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b9f2b66a-c6c8-4059-becb-cebbe1656eb7 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:59.025620 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b9f2b66a-c6c8-4059-becb-cebbe1656eb7 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:59.026346 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b9f2b66a-c6c8-4059-becb-cebbe1656eb7 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:59.099927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b9f2b66a-c6c8-4059-becb-cebbe1656eb7 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Going to try to terminate instance {{(pid=127166) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:40:59.258558 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b9f2b66a-c6c8-4059-becb-cebbe1656eb7 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 204 len: 0 microversion: 2.1 time: 0.255582 Aug 24 16:40:59.259316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 114/224] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:40:59 2022] DELETE /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:40:59.267618 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-82e5b1f3-3a9c-45cd-9421-5b9999ec10c6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:59.268275 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-82e5b1f3-3a9c-45cd-9421-5b9999ec10c6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:59.276288 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-82e5b1f3-3a9c-45cd-9421-5b9999ec10c6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:59.276780 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-82e5b1f3-3a9c-45cd-9421-5b9999ec10c6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:59.277210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-82e5b1f3-3a9c-45cd-9421-5b9999ec10c6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:59.277904 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-82e5b1f3-3a9c-45cd-9421-5b9999ec10c6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:59.278613 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-82e5b1f3-3a9c-45cd-9421-5b9999ec10c6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:59.279016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-82e5b1f3-3a9c-45cd-9421-5b9999ec10c6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:59.374643 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-bbbfb110-5e37-4afe-9a43-f9d5e954b5a3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:59.375701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-bbbfb110-5e37-4afe-9a43-f9d5e954b5a3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:59.384721 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbbfb110-5e37-4afe-9a43-f9d5e954b5a3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:59.385701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbbfb110-5e37-4afe-9a43-f9d5e954b5a3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:59.386437 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbbfb110-5e37-4afe-9a43-f9d5e954b5a3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:59.387762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbbfb110-5e37-4afe-9a43-f9d5e954b5a3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:59.388452 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbbfb110-5e37-4afe-9a43-f9d5e954b5a3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:59.389092 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bbbfb110-5e37-4afe-9a43-f9d5e954b5a3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:59.512540 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-82e5b1f3-3a9c-45cd-9421-5b9999ec10c6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:59.543063 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-82e5b1f3-3a9c-45cd-9421-5b9999ec10c6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1504 microversion: 2.1 time: 0.279255 Aug 24 16:40:59.546180 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 111/225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:59 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:59.573188 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7ba2c605-c471-4c40-b55b-b081c119a910 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:40:59.574043 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7ba2c605-c471-4c40-b55b-b081c119a910 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:40:59.583623 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ba2c605-c471-4c40-b55b-b081c119a910 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:59.584364 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ba2c605-c471-4c40-b55b-b081c119a910 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:59.584938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ba2c605-c471-4c40-b55b-b081c119a910 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:59.585956 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ba2c605-c471-4c40-b55b-b081c119a910 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:40:59.586606 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ba2c605-c471-4c40-b55b-b081c119a910 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:40:59.587768 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ba2c605-c471-4c40-b55b-b081c119a910 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:40:59.624053 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-bbbfb110-5e37-4afe-9a43-f9d5e954b5a3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:59.638461 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-bbbfb110-5e37-4afe-9a43-f9d5e954b5a3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.269769 Aug 24 16:40:59.639379 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 115/226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:59 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:40:59.822540 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7ba2c605-c471-4c40-b55b-b081c119a910 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:40:59.845515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7ba2c605-c471-4c40-b55b-b081c119a910 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1315 microversion: 2.1 time: 0.277683 Aug 24 16:40:59.848084 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 112/227] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:40:59 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:40:59.982883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-13d42e96-412d-4f1b-8802-a78cc89e3f10 req-1a7fbee0-3d53-4d39-955d-b8e539a3eef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4551440e-1d3e-4404-9a61-63b551cddffa", "name": "network-vif-plugged", "status": "completed", "tag": "07821013-da31-466e-a603-2a5751f770ae"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:00.020982 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-13d42e96-412d-4f1b-8802-a78cc89e3f10 req-1a7fbee0-3d53-4d39-955d-b8e539a3eef4 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:00.021767 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-13d42e96-412d-4f1b-8802-a78cc89e3f10 req-1a7fbee0-3d53-4d39-955d-b8e539a3eef4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:00.022207 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-13d42e96-412d-4f1b-8802-a78cc89e3f10 req-1a7fbee0-3d53-4d39-955d-b8e539a3eef4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:00.051598 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-13d42e96-412d-4f1b-8802-a78cc89e3f10 req-1a7fbee0-3d53-4d39-955d-b8e539a3eef4 service nova] Creating event network-vif-plugged:07821013-da31-466e-a603-2a5751f770ae for instance 4551440e-1d3e-4404-9a61-63b551cddffa on hv-cinder-77957 Aug 24 16:41:00.058854 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-13d42e96-412d-4f1b-8802-a78cc89e3f10 req-1a7fbee0-3d53-4d39-955d-b8e539a3eef4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079295 Aug 24 16:41:00.060129 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 116/228] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:00.566759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1d3e6f85-141b-4854-a904-7f79c7e35722 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:00.567433 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1d3e6f85-141b-4854-a904-7f79c7e35722 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:00.581426 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d3e6f85-141b-4854-a904-7f79c7e35722 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:00.583055 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d3e6f85-141b-4854-a904-7f79c7e35722 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:00.583494 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d3e6f85-141b-4854-a904-7f79c7e35722 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:00.584651 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d3e6f85-141b-4854-a904-7f79c7e35722 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:00.585100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d3e6f85-141b-4854-a904-7f79c7e35722 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:00.585525 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d3e6f85-141b-4854-a904-7f79c7e35722 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:00.661820 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-cab909e8-2ecb-4af7-9dde-74429f133465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:00.663319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-cab909e8-2ecb-4af7-9dde-74429f133465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:00.673593 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cab909e8-2ecb-4af7-9dde-74429f133465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:00.676816 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cab909e8-2ecb-4af7-9dde-74429f133465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:00.677689 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cab909e8-2ecb-4af7-9dde-74429f133465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:00.678736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cab909e8-2ecb-4af7-9dde-74429f133465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:00.679453 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cab909e8-2ecb-4af7-9dde-74429f133465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:00.680164 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cab909e8-2ecb-4af7-9dde-74429f133465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:00.852667 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1d3e6f85-141b-4854-a904-7f79c7e35722 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:00.864130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1d3e6f85-141b-4854-a904-7f79c7e35722 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1504 microversion: 2.1 time: 0.301633 Aug 24 16:41:00.878370 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 113/229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:00 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:00.883475 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-35dd396a-e632-435e-9445-3da5c0229c2e tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:00.884397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-35dd396a-e632-435e-9445-3da5c0229c2e tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:00.890550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35dd396a-e632-435e-9445-3da5c0229c2e tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:00.891335 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35dd396a-e632-435e-9445-3da5c0229c2e tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:00.891978 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35dd396a-e632-435e-9445-3da5c0229c2e tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:00.892903 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35dd396a-e632-435e-9445-3da5c0229c2e tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:00.894952 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35dd396a-e632-435e-9445-3da5c0229c2e tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:00.895593 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35dd396a-e632-435e-9445-3da5c0229c2e tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:01.084970 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-cab909e8-2ecb-4af7-9dde-74429f133465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:01.100409 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-cab909e8-2ecb-4af7-9dde-74429f133465 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.442536 Aug 24 16:41:01.114250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 117/230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:00 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:01.149524 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-35dd396a-e632-435e-9445-3da5c0229c2e tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:01.157285 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-35dd396a-e632-435e-9445-3da5c0229c2e tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1315 microversion: 2.1 time: 0.277561 Aug 24 16:41:01.157854 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 114/231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:00 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:01.884714 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-daf4141f-701d-4e50-95a5-9c62302deafa tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:01.885313 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-daf4141f-701d-4e50-95a5-9c62302deafa tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:01.891763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-daf4141f-701d-4e50-95a5-9c62302deafa tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:01.892286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-daf4141f-701d-4e50-95a5-9c62302deafa tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:01.892715 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-daf4141f-701d-4e50-95a5-9c62302deafa tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:01.893944 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-daf4141f-701d-4e50-95a5-9c62302deafa tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:01.894911 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-daf4141f-701d-4e50-95a5-9c62302deafa tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:01.895574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-daf4141f-701d-4e50-95a5-9c62302deafa tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:02.119241 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-17536426-25fc-4ac4-9c92-c5c2cbde5f1c req-8facfda5-251b-4c51-af4c-8dd16c786afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe94398-f654-4256-95b8-63740f301052", "name": "network-vif-deleted", "tag": "a1e459ed-3d0d-4dd7-a843-bbee7dc0af9a"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:02.133806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-17536426-25fc-4ac4-9c92-c5c2cbde5f1c req-8facfda5-251b-4c51-af4c-8dd16c786afb service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:02.134524 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-17536426-25fc-4ac4-9c92-c5c2cbde5f1c req-8facfda5-251b-4c51-af4c-8dd16c786afb service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:02.135165 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-17536426-25fc-4ac4-9c92-c5c2cbde5f1c req-8facfda5-251b-4c51-af4c-8dd16c786afb service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:02.151653 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-daf4141f-701d-4e50-95a5-9c62302deafa tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:02.153622 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-17536426-25fc-4ac4-9c92-c5c2cbde5f1c req-8facfda5-251b-4c51-af4c-8dd16c786afb service nova] Creating event network-vif-deleted:a1e459ed-3d0d-4dd7-a843-bbee7dc0af9a for instance 5fe94398-f654-4256-95b8-63740f301052 on hv-cinder-77957 Aug 24 16:41:02.160367 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-17536426-25fc-4ac4-9c92-c5c2cbde5f1c req-8facfda5-251b-4c51-af4c-8dd16c786afb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044866 Aug 24 16:41:02.161537 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 115/232] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:41:02.161647 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-daf4141f-701d-4e50-95a5-9c62302deafa tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1504 microversion: 2.1 time: 0.280383 Aug 24 16:41:02.168458 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 118/233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:01 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:02.182107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e7ec961e-609f-40e7-a116-158f8bb81975 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:02.183059 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e7ec961e-609f-40e7-a116-158f8bb81975 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:02.186331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-97a3d793-54bb-49ff-9178-742e17c425f6 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:02.187282 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-97a3d793-54bb-49ff-9178-742e17c425f6 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:02.191397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7ec961e-609f-40e7-a116-158f8bb81975 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:02.191893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7ec961e-609f-40e7-a116-158f8bb81975 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:02.192429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7ec961e-609f-40e7-a116-158f8bb81975 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:02.193280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7ec961e-609f-40e7-a116-158f8bb81975 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:02.193875 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7ec961e-609f-40e7-a116-158f8bb81975 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:02.194453 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e7ec961e-609f-40e7-a116-158f8bb81975 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:02.199728 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97a3d793-54bb-49ff-9178-742e17c425f6 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:02.200360 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97a3d793-54bb-49ff-9178-742e17c425f6 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:02.201015 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97a3d793-54bb-49ff-9178-742e17c425f6 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:02.201999 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97a3d793-54bb-49ff-9178-742e17c425f6 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:02.202662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97a3d793-54bb-49ff-9178-742e17c425f6 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:02.204671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97a3d793-54bb-49ff-9178-742e17c425f6 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:02.450735 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e7ec961e-609f-40e7-a116-158f8bb81975 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:02.453784 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-97a3d793-54bb-49ff-9178-742e17c425f6 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:02.459653 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e7ec961e-609f-40e7-a116-158f8bb81975 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1520 microversion: 2.1 time: 0.289881 Aug 24 16:41:02.460501 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 116/234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:02 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:02.466232 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-97a3d793-54bb-49ff-9178-742e17c425f6 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1315 microversion: 2.1 time: 0.286105 Aug 24 16:41:02.467350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 119/235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:02 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:03.188848 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:03.190143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:03.196672 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.197164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.197590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.198439 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.199052 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.199480 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.240621 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.241203 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.241516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.241949 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.objects.instance [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lazy-loading 'fault' on Instance uuid 5fe94398-f654-4256-95b8-63740f301052 {{(pid=127165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:41:03.301319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:03.309208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9bd0afaf-f26f-4e46-bb63-75f05d7c3875 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1303 microversion: 2.1 time: 0.126525 Aug 24 16:41:03.310269 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 117/236] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:03 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:03.482663 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-eaee3fac-e6b1-47d2-8358-24941c02b05d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:03.484077 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-eaee3fac-e6b1-47d2-8358-24941c02b05d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:03.493196 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaee3fac-e6b1-47d2-8358-24941c02b05d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.494019 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaee3fac-e6b1-47d2-8358-24941c02b05d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.494149 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-3a500cce-17c7-4c3a-93bb-bf1ece1f30f5 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:03.494645 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-3a500cce-17c7-4c3a-93bb-bf1ece1f30f5 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:03.494937 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaee3fac-e6b1-47d2-8358-24941c02b05d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.496092 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaee3fac-e6b1-47d2-8358-24941c02b05d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.496705 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaee3fac-e6b1-47d2-8358-24941c02b05d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.497369 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-eaee3fac-e6b1-47d2-8358-24941c02b05d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.505120 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3a500cce-17c7-4c3a-93bb-bf1ece1f30f5 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.505619 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3a500cce-17c7-4c3a-93bb-bf1ece1f30f5 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.506436 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3a500cce-17c7-4c3a-93bb-bf1ece1f30f5 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.507158 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3a500cce-17c7-4c3a-93bb-bf1ece1f30f5 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.508692 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3a500cce-17c7-4c3a-93bb-bf1ece1f30f5 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.509523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3a500cce-17c7-4c3a-93bb-bf1ece1f30f5 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.720569 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-3a500cce-17c7-4c3a-93bb-bf1ece1f30f5 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:03.733015 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-3a500cce-17c7-4c3a-93bb-bf1ece1f30f5 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1465 microversion: 2.1 time: 0.246124 Aug 24 16:41:03.748328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 118/237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:03 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1465 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:03.759656 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-eaee3fac-e6b1-47d2-8358-24941c02b05d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:03.768953 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-eaee3fac-e6b1-47d2-8358-24941c02b05d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1500 microversion: 2.1 time: 0.290671 Aug 24 16:41:03.780337 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 120/238] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:03 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1500 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:03.787422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e4c287cb-cba4-4973-aeed-9b3957ab10db tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:03.788238 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e4c287cb-cba4-4973-aeed-9b3957ab10db tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:03.792044 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9523c10b-4180-4659-b971-1abf8a2c69eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:03.792802 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9523c10b-4180-4659-b971-1abf8a2c69eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:03.801846 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523c10b-4180-4659-b971-1abf8a2c69eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.802216 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c287cb-cba4-4973-aeed-9b3957ab10db tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.802539 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523c10b-4180-4659-b971-1abf8a2c69eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.802844 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c287cb-cba4-4973-aeed-9b3957ab10db tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.802969 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523c10b-4180-4659-b971-1abf8a2c69eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.803465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c287cb-cba4-4973-aeed-9b3957ab10db tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.803982 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523c10b-4180-4659-b971-1abf8a2c69eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.804325 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c287cb-cba4-4973-aeed-9b3957ab10db tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.804425 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523c10b-4180-4659-b971-1abf8a2c69eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.804844 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523c10b-4180-4659-b971-1abf8a2c69eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.804941 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c287cb-cba4-4973-aeed-9b3957ab10db tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.805439 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c287cb-cba4-4973-aeed-9b3957ab10db tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.809523 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:03.834119 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e4c287cb-cba4-4973-aeed-9b3957ab10db tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:41:03.912273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e4c287cb-cba4-4973-aeed-9b3957ab10db tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 204 len: 0 microversion: 2.1 time: 0.130250 Aug 24 16:41:03.912856 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 119/239] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:41:03 2022] DELETE /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 16:41:03.921529 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-986c3f77-d794-41db-b0b9-789e4e534574 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:03.922256 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-986c3f77-d794-41db-b0b9-789e4e534574 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:03.929358 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-986c3f77-d794-41db-b0b9-789e4e534574 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.929844 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-986c3f77-d794-41db-b0b9-789e4e534574 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.930275 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-986c3f77-d794-41db-b0b9-789e4e534574 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.930971 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-986c3f77-d794-41db-b0b9-789e4e534574 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:03.931470 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-986c3f77-d794-41db-b0b9-789e4e534574 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:03.931892 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-986c3f77-d794-41db-b0b9-789e4e534574 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:03.948433 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9523c10b-4180-4659-b971-1abf8a2c69eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:03.957375 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9523c10b-4180-4659-b971-1abf8a2c69eb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1514 microversion: 2.1 time: 0.170143 Aug 24 16:41:03.958479 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 121/240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:03 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:04.038802 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fcc050e1-bb92-4a0f-b699-0408a4d53246 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:04.039496 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fcc050e1-bb92-4a0f-b699-0408a4d53246 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:04.048393 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fcc050e1-bb92-4a0f-b699-0408a4d53246 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:04.049201 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fcc050e1-bb92-4a0f-b699-0408a4d53246 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:04.050458 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fcc050e1-bb92-4a0f-b699-0408a4d53246 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:04.051554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fcc050e1-bb92-4a0f-b699-0408a4d53246 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:04.052315 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fcc050e1-bb92-4a0f-b699-0408a4d53246 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:04.053109 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fcc050e1-bb92-4a0f-b699-0408a4d53246 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:04.086536 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-fcc050e1-bb92-4a0f-b699-0408a4d53246 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/ips" status: 200 len: 151 microversion: 2.20 time: 0.052312 Aug 24 16:41:04.092254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 122/241] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Aug 24 16:41:04 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:41:04.109136 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-986c3f77-d794-41db-b0b9-789e4e534574 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:04.117384 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-986c3f77-d794-41db-b0b9-789e4e534574 tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1471 microversion: 2.1 time: 0.200175 Aug 24 16:41:04.124355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 120/242] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:03 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:04.340650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:04.341379 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:04.349921 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:04.350446 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:04.350853 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:04.351722 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:04.352385 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:04.352956 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:04.410566 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:04.411126 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:04.412008 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:04.412661 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lazy-loading 'fault' on Instance uuid 5fe94398-f654-4256-95b8-63740f301052 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:41:04.464932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:04.475842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9737625d-f71e-41eb-8d61-8c5afc69deac tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1303 microversion: 2.1 time: 0.148521 Aug 24 16:41:04.476706 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 123/243] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:04 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:05.137648 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-622ea0a9-58d7-46b5-a8eb-9a4e596ac4bf tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:05.138247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-622ea0a9-58d7-46b5-a8eb-9a4e596ac4bf tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:05.144640 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-622ea0a9-58d7-46b5-a8eb-9a4e596ac4bf tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:05.145114 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-622ea0a9-58d7-46b5-a8eb-9a4e596ac4bf tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:05.145546 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-622ea0a9-58d7-46b5-a8eb-9a4e596ac4bf tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:05.146218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-622ea0a9-58d7-46b5-a8eb-9a4e596ac4bf tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:05.146680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-622ea0a9-58d7-46b5-a8eb-9a4e596ac4bf tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:05.147092 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-622ea0a9-58d7-46b5-a8eb-9a4e596ac4bf tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:05.277266 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-622ea0a9-58d7-46b5-a8eb-9a4e596ac4bf tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:05.286448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-622ea0a9-58d7-46b5-a8eb-9a4e596ac4bf tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1471 microversion: 2.1 time: 0.152565 Aug 24 16:41:05.287025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 121/244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:05 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:05.462182 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-94dd6c9a-9ba7-41b1-8ca5-145e63b972d7 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:05.464497 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-94dd6c9a-9ba7-41b1-8ca5-145e63b972d7 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:05.470435 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-94dd6c9a-9ba7-41b1-8ca5-145e63b972d7 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:05.470915 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-94dd6c9a-9ba7-41b1-8ca5-145e63b972d7 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:05.471847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-94dd6c9a-9ba7-41b1-8ca5-145e63b972d7 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:05.472560 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-94dd6c9a-9ba7-41b1-8ca5-145e63b972d7 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:05.473010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-94dd6c9a-9ba7-41b1-8ca5-145e63b972d7 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:05.473429 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-94dd6c9a-9ba7-41b1-8ca5-145e63b972d7 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:05.496893 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-94dd6c9a-9ba7-41b1-8ca5-145e63b972d7 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lazy-loading 'flavor' on Instance uuid 1ad10931-9764-4362-a3b6-c5cd27974783 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:41:05.501261 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:05.501971 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:05.507849 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:05.508376 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:05.508817 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:05.509509 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:05.509962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:05.510388 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:05.660089 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-94dd6c9a-9ba7-41b1-8ca5-145e63b972d7 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783/action" status: 200 len: 32 microversion: 2.1 time: 0.198863 Aug 24 16:41:05.662223 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 124/245] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:41:05 2022] POST /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:41:05.673042 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-12d5463a-fddf-428f-b0ad-8163e1ed9a06 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:05.673928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-12d5463a-fddf-428f-b0ad-8163e1ed9a06 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:05.686459 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d5463a-fddf-428f-b0ad-8163e1ed9a06 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:05.687737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d5463a-fddf-428f-b0ad-8163e1ed9a06 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:05.688367 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d5463a-fddf-428f-b0ad-8163e1ed9a06 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:05.689237 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d5463a-fddf-428f-b0ad-8163e1ed9a06 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:05.690380 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d5463a-fddf-428f-b0ad-8163e1ed9a06 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:05.691088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d5463a-fddf-428f-b0ad-8163e1ed9a06 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:05.701088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:05.701575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:05.702058 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:05.702591 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.objects.instance [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lazy-loading 'fault' on Instance uuid 5fe94398-f654-4256-95b8-63740f301052 {{(pid=127165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:41:05.757218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:05.764375 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9b29f91b-2c8e-4cfe-a91c-fa139e1b7b6f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 200 len: 1303 microversion: 2.1 time: 0.266979 Aug 24 16:41:05.764940 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 122/246] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:05 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 1303 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:05.855600 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-12d5463a-fddf-428f-b0ad-8163e1ed9a06 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:05.863706 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-12d5463a-fddf-428f-b0ad-8163e1ed9a06 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.195322 Aug 24 16:41:05.864410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 125/247] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:05 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:06.310997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d8cd036b-9c45-4b19-b68b-24b5a498fcac tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:06.312297 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d8cd036b-9c45-4b19-b68b-24b5a498fcac tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:06.321301 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d8cd036b-9c45-4b19-b68b-24b5a498fcac tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:06.321818 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d8cd036b-9c45-4b19-b68b-24b5a498fcac tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:06.322457 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d8cd036b-9c45-4b19-b68b-24b5a498fcac tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:06.323977 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d8cd036b-9c45-4b19-b68b-24b5a498fcac tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:06.324592 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d8cd036b-9c45-4b19-b68b-24b5a498fcac tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:06.325301 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d8cd036b-9c45-4b19-b68b-24b5a498fcac tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:06.597238 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d8cd036b-9c45-4b19-b68b-24b5a498fcac tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee66b7c264dd44db887898923c925dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe5a43a5024141fc9c9977086b245550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:06.608791 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d8cd036b-9c45-4b19-b68b-24b5a498fcac tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 200 len: 1471 microversion: 2.1 time: 0.303770 Aug 24 16:41:06.609232 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 123/248] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:06 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:06.788117 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:06.789175 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: 5fe94398-f654-4256-95b8-63740f301052] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:06.797320 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:06.797943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:06.798908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:06.800535 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:06.801092 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:06.801864 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:06.820272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] HTTP exception thrown: Instance 5fe94398-f654-4256-95b8-63740f301052 could not be found. Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Request method failure captured: Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 HTTP/1.1 Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlSG5F2o5L4HLpIcAc3L2EYRvJBH2tig01MmeKXgzVtW43s5axfnrEakQoOMZJ192lOdREll_8srT6Ij3hFEoByk0uYlXldUt5SUQSH9I9uRzn5Gtl06_7Y6wnHlJITLsmtB6n0nz-pent9Po_F0pA8w3e_KR-FmXfKfjpT2V-1IVi0 Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 8424741e1d154c6c9b08b19fb7c61d33 Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-VolumesActionsTest-1757398995 Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:41:06.822046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8424741e1d154c6c9b08b19fb7c61d33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8424741e1d154c6c9b08b19fb7c61d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8424741e1d154c6c9b08b19fb7c61d33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8424741e1d154c6c9b08b19fb7c61d33", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-VolumesActionsTest-1757398995 Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 8424741e1d154c6c9b08b19fb7c61d33 Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-VolumesActionsTest-1757398995 Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-VolumesActionsTest-1757398995-project Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: e4b36e6959444273872c300742d6ddb8 Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-VolumesActionsTest-1757398995-project Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 5fe94398-f654-4256-95b8-63740f301052 could not be found. Aug 24 16:41:06.823286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '5fe94398-f654-4256-95b8-63740f301052'} Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe94398-f654-4256-95b8-63740f301052 could not be found. Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:41:06.823989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe94398-f654-4256-95b8-63740f301052 could not be found. Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe94398-f654-4256-95b8-63740f301052 could not be found. Aug 24 16:41:06.825181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:41:06.826137 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Returning 404 to user: Instance 5fe94398-f654-4256-95b8-63740f301052 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:41:06.826137 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d2def5ba-8111-43f6-865f-1143acf8ba55 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052" status: 404 len: 111 microversion: 2.1 time: 0.041055 Aug 24 16:41:06.827935 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 126/249] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:06 2022] GET /compute/v2.1/servers/5fe94398-f654-4256-95b8-63740f301052 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:41:06.887426 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-753a611c-60ac-4f5b-83eb-ee23c742c75f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:06.888353 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-753a611c-60ac-4f5b-83eb-ee23c742c75f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:06.896927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-753a611c-60ac-4f5b-83eb-ee23c742c75f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:06.897443 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-753a611c-60ac-4f5b-83eb-ee23c742c75f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:06.897918 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-753a611c-60ac-4f5b-83eb-ee23c742c75f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:06.898886 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-753a611c-60ac-4f5b-83eb-ee23c742c75f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:06.899322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-753a611c-60ac-4f5b-83eb-ee23c742c75f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:06.899912 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-753a611c-60ac-4f5b-83eb-ee23c742c75f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:06.932528 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:06.947560 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-c112f1bb-1fad-4b40-8121-50b32f0a2b0f req-fa357b29-e56f-474d-8591-8029b9ec4013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4551440e-1d3e-4404-9a61-63b551cddffa", "name": "network-vif-deleted", "tag": "07821013-da31-466e-a603-2a5751f770ae"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:06.957545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c112f1bb-1fad-4b40-8121-50b32f0a2b0f req-fa357b29-e56f-474d-8591-8029b9ec4013 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:06.958018 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c112f1bb-1fad-4b40-8121-50b32f0a2b0f req-fa357b29-e56f-474d-8591-8029b9ec4013 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:06.958438 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c112f1bb-1fad-4b40-8121-50b32f0a2b0f req-fa357b29-e56f-474d-8591-8029b9ec4013 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:06.983688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-c112f1bb-1fad-4b40-8121-50b32f0a2b0f req-fa357b29-e56f-474d-8591-8029b9ec4013 service nova] Creating event network-vif-deleted:07821013-da31-466e-a603-2a5751f770ae for instance 4551440e-1d3e-4404-9a61-63b551cddffa on hv-cinder-77957 Aug 24 16:41:06.988648 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-c112f1bb-1fad-4b40-8121-50b32f0a2b0f req-fa357b29-e56f-474d-8591-8029b9ec4013 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044882 Aug 24 16:41:06.989565 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 127/250] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 24 16:41:06.995164 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2104993399", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "networks": [{"uuid": "a492a2d3-2313-422d-b78f-b12dffc5a834"}]}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:07.092304 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-753a611c-60ac-4f5b-83eb-ee23c742c75f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:07.100615 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-753a611c-60ac-4f5b-83eb-ee23c742c75f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.219025 Aug 24 16:41:07.101191 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 124/251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:06 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:07.200682 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] validate_networks() for [('a492a2d3-2313-422d-b78f-b12dffc5a834', None, None, None, None, None)] {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:41:07.610875 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:41:07.611392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:41:07.612661 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:41:07.613291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:41:07.613811 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:41:07.624308 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:07.625251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:07.625970 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:07.626972 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:07.627493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:07.628141 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:07.634866 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:07.635640 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] [instance: 4551440e-1d3e-4404-9a61-63b551cddffa] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:07.642338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:07.642899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:07.643514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:07.644552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:07.645004 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:07.645422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:07.646147 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Getting quotas for project 8424741e1d154c6c9b08b19fb7c61d33. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:41:07.650785 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Getting quotas for user e4b36e6959444273872c300742d6ddb8 and project 8424741e1d154c6c9b08b19fb7c61d33. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:41:07.663577 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] HTTP exception thrown: Instance 4551440e-1d3e-4404-9a61-63b551cddffa could not be found. Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Request method failure captured: Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa HTTP/1.1 Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlSL44e3b1U1x7QVWMZYRykePLhpUD-pvRaXd-8Psru6lxQrJFvfJd4E_a7evsiAzie61oljV4hcEnH68aFCWh6xD01KWR0kOEjBTXODf2K_XhgvEu2A11PqEadBZIMZbDOZEH6Tt8gZobniXFHamvRDeAm-QbRTvLfCsq2uW3yrkrU Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: fe5a43a5024141fc9c9977086b245550 Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-VolumesNegativeTest-478657694 Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:41:07.665620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe5a43a5024141fc9c9977086b245550"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe5a43a5024141fc9c9977086b245550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe5a43a5024141fc9c9977086b245550"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe5a43a5024141fc9c9977086b245550", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-VolumesNegativeTest-478657694 Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: fe5a43a5024141fc9c9977086b245550 Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-VolumesNegativeTest-478657694 Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-VolumesNegativeTest-478657694-project Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: ee66b7c264dd44db887898923c925dc8 Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-VolumesNegativeTest-478657694-project Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 4551440e-1d3e-4404-9a61-63b551cddffa could not be found. Aug 24 16:41:07.667514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '4551440e-1d3e-4404-9a61-63b551cddffa'} Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4551440e-1d3e-4404-9a61-63b551cddffa could not be found. Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:41:07.668474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4551440e-1d3e-4404-9a61-63b551cddffa could not be found. Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4551440e-1d3e-4404-9a61-63b551cddffa could not be found. Aug 24 16:41:07.670349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:07.672649 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] Returning 404 to user: Instance 4551440e-1d3e-4404-9a61-63b551cddffa could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:41:07.672649 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-169c8263-9330-45fa-833c-33bf6bc1ea8b tempest-VolumesNegativeTest-478657694 tempest-VolumesNegativeTest-478657694-project] 10.222.0.52 "GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa" status: 404 len: 111 microversion: 2.1 time: 0.036790 Aug 24 16:41:07.672976 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 125/252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:07 2022] GET /compute/v2.1/servers/4551440e-1d3e-4404-9a61-63b551cddffa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:41:07.677786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:41:07.680627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:41:07.779833 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1cc45148-4584-4b58-be08-5e7bf129ad8d tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788713 Aug 24 16:41:07.782843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 128/253] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:41:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:41:07.798107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-19afb187-6f7f-4c7f-8a56-9e2fe8833de4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:07.799032 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-19afb187-6f7f-4c7f-8a56-9e2fe8833de4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:07.907450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-68e5b42b-ea91-49fa-8486-69870bd33543 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:07.908860 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-68e5b42b-ea91-49fa-8486-69870bd33543 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:07.929002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-68e5b42b-ea91-49fa-8486-69870bd33543 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:07.932487 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-68e5b42b-ea91-49fa-8486-69870bd33543 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:07.933089 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-68e5b42b-ea91-49fa-8486-69870bd33543 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:07.933942 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-68e5b42b-ea91-49fa-8486-69870bd33543 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:07.936115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-68e5b42b-ea91-49fa-8486-69870bd33543 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:07.936639 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-68e5b42b-ea91-49fa-8486-69870bd33543 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:07.980065 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-68e5b42b-ea91-49fa-8486-69870bd33543 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lazy-loading 'flavor' on Instance uuid 66f46124-a6dc-4300-88a6-3143240719da {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:41:08.321680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-19afb187-6f7f-4c7f-8a56-9e2fe8833de4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:08.328834 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-19afb187-6f7f-4c7f-8a56-9e2fe8833de4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1214 microversion: 2.1 time: 0.538051 Aug 24 16:41:08.343900 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 126/254] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:07 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1214 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:08.349256 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4279bbb0-ac07-4ba9-a976-99c0bde3829f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:08.349852 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4279bbb0-ac07-4ba9-a976-99c0bde3829f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:08.356453 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4279bbb0-ac07-4ba9-a976-99c0bde3829f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:08.356941 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4279bbb0-ac07-4ba9-a976-99c0bde3829f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:08.357363 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4279bbb0-ac07-4ba9-a976-99c0bde3829f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:08.358292 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4279bbb0-ac07-4ba9-a976-99c0bde3829f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:08.358839 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4279bbb0-ac07-4ba9-a976-99c0bde3829f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:08.359424 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4279bbb0-ac07-4ba9-a976-99c0bde3829f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:08.532522 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4279bbb0-ac07-4ba9-a976-99c0bde3829f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:08.544163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4279bbb0-ac07-4ba9-a976-99c0bde3829f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.199100 Aug 24 16:41:08.544753 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 127/255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:08 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:08.918652 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-68e5b42b-ea91-49fa-8486-69870bd33543 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "POST /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/action" status: 202 len: 0 microversion: 2.20 time: 1.017783 Aug 24 16:41:08.919733 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 129/256] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 24 16:41:07 2022] POST /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/action => generated 0 bytes in 1020 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:41:08.928211 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:08.928915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:08.954100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:08.954601 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:08.955045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:08.959739 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:08.960813 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:08.961262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:09.199370 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:09.208868 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:09.211161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:09.212544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0ae17e3a-c9e9-4e3d-87d1-228dd0aa13d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.288642 Aug 24 16:41:09.213534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 128/257] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:08 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:09.352044 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6a504e01-12ee-4fd2-945b-0740566e7b35 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:09.352968 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6a504e01-12ee-4fd2-945b-0740566e7b35 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:09.359451 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a504e01-12ee-4fd2-945b-0740566e7b35 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:09.360153 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a504e01-12ee-4fd2-945b-0740566e7b35 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:09.360848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a504e01-12ee-4fd2-945b-0740566e7b35 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:09.362168 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a504e01-12ee-4fd2-945b-0740566e7b35 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:09.363091 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a504e01-12ee-4fd2-945b-0740566e7b35 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:09.363586 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a504e01-12ee-4fd2-945b-0740566e7b35 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:09.437964 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6a504e01-12ee-4fd2-945b-0740566e7b35 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:09.446908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6a504e01-12ee-4fd2-945b-0740566e7b35 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1274 microversion: 2.1 time: 0.100517 Aug 24 16:41:09.448199 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 130/258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:09 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:09.566278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d39da911-6ff2-4bdf-b57a-9bc189f0c481 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:09.567015 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d39da911-6ff2-4bdf-b57a-9bc189f0c481 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:09.573259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d39da911-6ff2-4bdf-b57a-9bc189f0c481 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:09.573749 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d39da911-6ff2-4bdf-b57a-9bc189f0c481 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:09.574408 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d39da911-6ff2-4bdf-b57a-9bc189f0c481 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:09.574960 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d39da911-6ff2-4bdf-b57a-9bc189f0c481 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:09.575677 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d39da911-6ff2-4bdf-b57a-9bc189f0c481 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:09.576218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d39da911-6ff2-4bdf-b57a-9bc189f0c481 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:09.761950 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d39da911-6ff2-4bdf-b57a-9bc189f0c481 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:09.770909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d39da911-6ff2-4bdf-b57a-9bc189f0c481 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.209074 Aug 24 16:41:09.771507 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 129/259] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:09 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:10.239366 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:10.240718 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:10.248662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:10.249374 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:10.250483 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:10.251708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:10.252705 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:10.253493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:10.419404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:10.431012 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:10.432882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:10.434113 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2b7d0d5f-de9b-4be1-869b-49d781e2f5f7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.199614 Aug 24 16:41:10.447991 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 131/260] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:10 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:10.478790 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8acc11d5-f962-44b1-b81b-b008652bd42c tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:10.479408 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8acc11d5-f962-44b1-b81b-b008652bd42c tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:10.488037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8acc11d5-f962-44b1-b81b-b008652bd42c tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:10.488770 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8acc11d5-f962-44b1-b81b-b008652bd42c tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:10.489247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8acc11d5-f962-44b1-b81b-b008652bd42c tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:10.490141 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8acc11d5-f962-44b1-b81b-b008652bd42c tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:10.490852 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8acc11d5-f962-44b1-b81b-b008652bd42c tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:10.491334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8acc11d5-f962-44b1-b81b-b008652bd42c tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:10.696346 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8acc11d5-f962-44b1-b81b-b008652bd42c tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:10.710193 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8acc11d5-f962-44b1-b81b-b008652bd42c tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.240634 Aug 24 16:41:10.718967 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 130/261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:10 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:10.794425 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e57a11cc-33a8-4450-bb2b-8b5df6db3f26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:10.795421 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e57a11cc-33a8-4450-bb2b-8b5df6db3f26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:10.803992 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e57a11cc-33a8-4450-bb2b-8b5df6db3f26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:10.804805 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e57a11cc-33a8-4450-bb2b-8b5df6db3f26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:10.805243 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e57a11cc-33a8-4450-bb2b-8b5df6db3f26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:10.806085 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e57a11cc-33a8-4450-bb2b-8b5df6db3f26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:10.807049 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e57a11cc-33a8-4450-bb2b-8b5df6db3f26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:10.807483 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e57a11cc-33a8-4450-bb2b-8b5df6db3f26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:10.983855 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-4b13a0aa-1f6d-4e14-91db-22af4fd0ed18 req-b8980fd9-405c-4879-bfc9-be08c4c85243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd320ce6-9330-4f84-8d6e-bd6b776fe22a", "tag": "472d117d-1a7a-49b3-b8c4-207aa2b41e73"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:11.024089 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-4b13a0aa-1f6d-4e14-91db-22af4fd0ed18 req-b8980fd9-405c-4879-bfc9-be08c4c85243 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:11.027046 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-4b13a0aa-1f6d-4e14-91db-22af4fd0ed18 req-b8980fd9-405c-4879-bfc9-be08c4c85243 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:11.028103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-4b13a0aa-1f6d-4e14-91db-22af4fd0ed18 req-b8980fd9-405c-4879-bfc9-be08c4c85243 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:11.044201 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e57a11cc-33a8-4450-bb2b-8b5df6db3f26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:11.052583 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-4b13a0aa-1f6d-4e14-91db-22af4fd0ed18 req-b8980fd9-405c-4879-bfc9-be08c4c85243 service nova] Creating event network-changed:472d117d-1a7a-49b3-b8c4-207aa2b41e73 for instance bd320ce6-9330-4f84-8d6e-bd6b776fe22a on hv-cinder-77957 Aug 24 16:41:11.055477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e57a11cc-33a8-4450-bb2b-8b5df6db3f26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.266524 Aug 24 16:41:11.056402 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 132/262] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:10 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:11.067459 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-4b13a0aa-1f6d-4e14-91db-22af4fd0ed18 req-b8980fd9-405c-4879-bfc9-be08c4c85243 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087477 Aug 24 16:41:11.068118 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 131/263] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:11.463416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:11.464156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:11.473687 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:11.474170 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:11.474597 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:11.475294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:11.475736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:11.476216 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:11.635667 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:11.646234 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:11.648009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:11.649897 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-fd28c72e-305f-47f7-b785-fa7f5d8239d3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.193302 Aug 24 16:41:11.650618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 133/264] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:11 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:11.732135 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8c92a31b-6dce-4f19-b07b-6efc95088ae6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:11.732835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8c92a31b-6dce-4f19-b07b-6efc95088ae6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:11.740034 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c92a31b-6dce-4f19-b07b-6efc95088ae6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:11.740723 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c92a31b-6dce-4f19-b07b-6efc95088ae6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:11.741159 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c92a31b-6dce-4f19-b07b-6efc95088ae6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:11.741861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c92a31b-6dce-4f19-b07b-6efc95088ae6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:11.743708 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c92a31b-6dce-4f19-b07b-6efc95088ae6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:11.744440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c92a31b-6dce-4f19-b07b-6efc95088ae6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:11.910732 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8c92a31b-6dce-4f19-b07b-6efc95088ae6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:11.917653 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8c92a31b-6dce-4f19-b07b-6efc95088ae6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.190406 Aug 24 16:41:11.918508 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 132/265] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:11 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:12.085911 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-67cb5d35-1249-49fb-af51-0d8fcb52c56b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:12.086628 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-67cb5d35-1249-49fb-af51-0d8fcb52c56b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:12.093798 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-67cb5d35-1249-49fb-af51-0d8fcb52c56b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:12.094371 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-67cb5d35-1249-49fb-af51-0d8fcb52c56b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:12.095060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-67cb5d35-1249-49fb-af51-0d8fcb52c56b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:12.095741 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-67cb5d35-1249-49fb-af51-0d8fcb52c56b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:12.096892 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-67cb5d35-1249-49fb-af51-0d8fcb52c56b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:12.097711 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-67cb5d35-1249-49fb-af51-0d8fcb52c56b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:12.242302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-67cb5d35-1249-49fb-af51-0d8fcb52c56b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:12.250292 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-67cb5d35-1249-49fb-af51-0d8fcb52c56b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.168330 Aug 24 16:41:12.250858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 134/266] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:12 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:12.677288 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:12.678123 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:12.685515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:12.686008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:12.686583 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:12.687266 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:12.687799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:12.690629 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:12.840696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:12.849049 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:12.850562 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:12.851870 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-deb5dee4-3fd6-49e8-9bc9-0d7694dbaa36 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.179687 Aug 24 16:41:12.852476 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 133/267] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:12 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:12.939222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5fc7dce3-1ca2-4adb-a091-2a367f2ba6a9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:12.940615 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5fc7dce3-1ca2-4adb-a091-2a367f2ba6a9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:12.946538 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5fc7dce3-1ca2-4adb-a091-2a367f2ba6a9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:12.947064 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5fc7dce3-1ca2-4adb-a091-2a367f2ba6a9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:12.947535 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5fc7dce3-1ca2-4adb-a091-2a367f2ba6a9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:12.948314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5fc7dce3-1ca2-4adb-a091-2a367f2ba6a9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:12.948809 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5fc7dce3-1ca2-4adb-a091-2a367f2ba6a9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:12.949282 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5fc7dce3-1ca2-4adb-a091-2a367f2ba6a9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:13.086591 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5fc7dce3-1ca2-4adb-a091-2a367f2ba6a9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:13.090556 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:13.097804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5fc7dce3-1ca2-4adb-a091-2a367f2ba6a9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.162380 Aug 24 16:41:13.098406 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 135/268] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:12 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:13.271003 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e2f1f7ee-09a7-4fa0-8b67-594c16fc5524 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:13.271645 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e2f1f7ee-09a7-4fa0-8b67-594c16fc5524 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:13.277440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e2f1f7ee-09a7-4fa0-8b67-594c16fc5524 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:13.278178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e2f1f7ee-09a7-4fa0-8b67-594c16fc5524 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:13.278609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e2f1f7ee-09a7-4fa0-8b67-594c16fc5524 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:13.279304 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e2f1f7ee-09a7-4fa0-8b67-594c16fc5524 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:13.279765 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e2f1f7ee-09a7-4fa0-8b67-594c16fc5524 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:13.280214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e2f1f7ee-09a7-4fa0-8b67-594c16fc5524 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:13.425973 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e2f1f7ee-09a7-4fa0-8b67-594c16fc5524 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:13.433917 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e2f1f7ee-09a7-4fa0-8b67-594c16fc5524 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.167241 Aug 24 16:41:13.434476 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 134/269] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:13 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:13.874893 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:13.875577 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:13.882835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:13.883316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:13.883740 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:13.884461 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:13.884905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:13.885319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:14.023863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:14.032989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:14.034639 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:14.035847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-300f5ce3-f688-496d-9775-1dd5479ac6e0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.165150 Aug 24 16:41:14.036446 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 136/270] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:13 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:14.118299 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6a62a5ef-6a99-4fc5-8aac-01975834ac12 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:14.119013 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6a62a5ef-6a99-4fc5-8aac-01975834ac12 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:14.125565 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6a62a5ef-6a99-4fc5-8aac-01975834ac12 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:14.126065 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6a62a5ef-6a99-4fc5-8aac-01975834ac12 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:14.126553 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6a62a5ef-6a99-4fc5-8aac-01975834ac12 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:14.127337 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6a62a5ef-6a99-4fc5-8aac-01975834ac12 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:14.127854 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6a62a5ef-6a99-4fc5-8aac-01975834ac12 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:14.128367 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6a62a5ef-6a99-4fc5-8aac-01975834ac12 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:14.304876 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6a62a5ef-6a99-4fc5-8aac-01975834ac12 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:14.322631 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6a62a5ef-6a99-4fc5-8aac-01975834ac12 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.208105 Aug 24 16:41:14.323237 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 135/271] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:14 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:14.454430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c7e24406-2434-401c-9626-dd2ee4979868 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:14.455133 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c7e24406-2434-401c-9626-dd2ee4979868 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:14.467216 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7e24406-2434-401c-9626-dd2ee4979868 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:14.467722 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7e24406-2434-401c-9626-dd2ee4979868 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:14.468226 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7e24406-2434-401c-9626-dd2ee4979868 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:14.469007 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7e24406-2434-401c-9626-dd2ee4979868 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:14.469463 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7e24406-2434-401c-9626-dd2ee4979868 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:14.469956 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7e24406-2434-401c-9626-dd2ee4979868 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:14.626980 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c7e24406-2434-401c-9626-dd2ee4979868 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:14.635479 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c7e24406-2434-401c-9626-dd2ee4979868 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.184751 Aug 24 16:41:14.635990 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 137/272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:14 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:15.058585 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:15.059225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:15.065243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:15.065712 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:15.066147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:15.066851 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:15.067307 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:15.067728 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:15.214410 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:15.223893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:15.225672 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:15.226840 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-954ab9c1-81e1-4ca3-b2af-3fbf05055e33 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.172177 Aug 24 16:41:15.227567 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 136/273] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:15 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:15.342946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fee744e2-5903-4686-bc88-abf662cbc950 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:15.344200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fee744e2-5903-4686-bc88-abf662cbc950 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:15.350913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fee744e2-5903-4686-bc88-abf662cbc950 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:15.351467 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fee744e2-5903-4686-bc88-abf662cbc950 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:15.352108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fee744e2-5903-4686-bc88-abf662cbc950 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:15.353037 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fee744e2-5903-4686-bc88-abf662cbc950 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:15.353652 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fee744e2-5903-4686-bc88-abf662cbc950 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:15.354404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fee744e2-5903-4686-bc88-abf662cbc950 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:15.571134 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fee744e2-5903-4686-bc88-abf662cbc950 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:15.578936 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-fee744e2-5903-4686-bc88-abf662cbc950 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.240074 Aug 24 16:41:15.580024 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 138/274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:15 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:15.656788 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-581579f0-6bdd-4071-aae9-e1daef827a16 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:15.657404 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-581579f0-6bdd-4071-aae9-e1daef827a16 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:15.664067 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-581579f0-6bdd-4071-aae9-e1daef827a16 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:15.664842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-581579f0-6bdd-4071-aae9-e1daef827a16 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:15.665442 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-581579f0-6bdd-4071-aae9-e1daef827a16 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:15.666485 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-581579f0-6bdd-4071-aae9-e1daef827a16 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:15.666945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-581579f0-6bdd-4071-aae9-e1daef827a16 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:15.667372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-581579f0-6bdd-4071-aae9-e1daef827a16 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:15.824065 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-581579f0-6bdd-4071-aae9-e1daef827a16 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:15.833789 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-581579f0-6bdd-4071-aae9-e1daef827a16 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.180966 Aug 24 16:41:15.834460 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 137/275] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:15 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:16.251903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:16.253687 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:16.261346 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:16.262347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:16.263519 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:16.264764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:16.265454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:16.266201 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:16.490220 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:16.516252 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:16.518013 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:16.523759 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-11832586-4539-4801-bfa8-b258f6682ec2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.271996 Aug 24 16:41:16.524685 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 139/276] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:16 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:16.601586 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-37c5e7fa-ea0e-4ae8-9a8b-a8df5b8f5af3 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:16.602191 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-37c5e7fa-ea0e-4ae8-9a8b-a8df5b8f5af3 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:16.611487 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-37c5e7fa-ea0e-4ae8-9a8b-a8df5b8f5af3 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:16.612520 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-37c5e7fa-ea0e-4ae8-9a8b-a8df5b8f5af3 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:16.612947 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-37c5e7fa-ea0e-4ae8-9a8b-a8df5b8f5af3 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:16.613697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-37c5e7fa-ea0e-4ae8-9a8b-a8df5b8f5af3 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:16.614096 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-37c5e7fa-ea0e-4ae8-9a8b-a8df5b8f5af3 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:16.617241 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-37c5e7fa-ea0e-4ae8-9a8b-a8df5b8f5af3 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:16.860207 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-37c5e7fa-ea0e-4ae8-9a8b-a8df5b8f5af3 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:16.864127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-28da6cfa-85e3-41a1-9600-4b80596c7e4f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:16.865102 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-28da6cfa-85e3-41a1-9600-4b80596c7e4f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:16.871686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-37c5e7fa-ea0e-4ae8-9a8b-a8df5b8f5af3 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.274003 Aug 24 16:41:16.873648 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28da6cfa-85e3-41a1-9600-4b80596c7e4f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:16.874130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 138/277] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:16 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:16.874739 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28da6cfa-85e3-41a1-9600-4b80596c7e4f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:16.875320 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28da6cfa-85e3-41a1-9600-4b80596c7e4f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:16.876221 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28da6cfa-85e3-41a1-9600-4b80596c7e4f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:16.879550 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28da6cfa-85e3-41a1-9600-4b80596c7e4f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:16.881095 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28da6cfa-85e3-41a1-9600-4b80596c7e4f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:17.082171 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-28da6cfa-85e3-41a1-9600-4b80596c7e4f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:17.090018 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-28da6cfa-85e3-41a1-9600-4b80596c7e4f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.233194 Aug 24 16:41:17.090604 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 140/278] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:16 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:17.547638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:17.548267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:17.563178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:17.563971 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:17.564200 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:17.564888 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:17.565415 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:17.565878 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:17.724018 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:17.732502 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:17.734641 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:17.736009 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-64eddb1e-0aa9-47a7-9801-bf55da671f81 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.192230 Aug 24 16:41:17.738223 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 139/279] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:17 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:17.894535 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5b5e8f66-d1cc-4c57-b7ca-7c0a60767ab9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:17.896318 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5b5e8f66-d1cc-4c57-b7ca-7c0a60767ab9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:17.900414 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:17.901200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=6 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:17.922738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b5e8f66-d1cc-4c57-b7ca-7c0a60767ab9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:17.923239 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b5e8f66-d1cc-4c57-b7ca-7c0a60767ab9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:17.923674 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b5e8f66-d1cc-4c57-b7ca-7c0a60767ab9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:17.929268 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b5e8f66-d1cc-4c57-b7ca-7c0a60767ab9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:17.929755 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b5e8f66-d1cc-4c57-b7ca-7c0a60767ab9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:17.930379 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b5e8f66-d1cc-4c57-b7ca-7c0a60767ab9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:18.112899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0929d3b9-27d3-4873-ba15-a662f0ce9234 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:18.112899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0929d3b9-27d3-4873-ba15-a662f0ce9234 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:18.120422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0929d3b9-27d3-4873-ba15-a662f0ce9234 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:18.120691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0929d3b9-27d3-4873-ba15-a662f0ce9234 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:18.121116 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0929d3b9-27d3-4873-ba15-a662f0ce9234 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:18.121813 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0929d3b9-27d3-4873-ba15-a662f0ce9234 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:18.122264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0929d3b9-27d3-4873-ba15-a662f0ce9234 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:18.122680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0929d3b9-27d3-4873-ba15-a662f0ce9234 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:18.311897 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5b5e8f66-d1cc-4c57-b7ca-7c0a60767ab9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:18.321629 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5b5e8f66-d1cc-4c57-b7ca-7c0a60767ab9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.431832 Aug 24 16:41:18.329502 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:18.336831 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 141/280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:17 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:18.484187 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-0929d3b9-27d3-4873-ba15-a662f0ce9234 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:18.501045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0929d3b9-27d3-4873-ba15-a662f0ce9234 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.389855 Aug 24 16:41:18.506615 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 140/281] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:18 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:18.763424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:18.764097 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:18.771075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:18.771218 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:18.771697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:18.771697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:18.773264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:18.773526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:18.923252 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:18.933575 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:18.935351 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:18.936643 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f2c934f9-b5c3-43fe-8d98-4a907aa9c3f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.177252 Aug 24 16:41:18.937275 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 142/282] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:18 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:19.348372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4bd9c1c2-d120-4354-a56e-110c7062a73f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:19.349180 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4bd9c1c2-d120-4354-a56e-110c7062a73f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:19.357486 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:19.359630 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bd9c1c2-d120-4354-a56e-110c7062a73f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:19.360504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bd9c1c2-d120-4354-a56e-110c7062a73f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:19.361113 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bd9c1c2-d120-4354-a56e-110c7062a73f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:19.363103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bd9c1c2-d120-4354-a56e-110c7062a73f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:19.363714 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bd9c1c2-d120-4354-a56e-110c7062a73f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:19.364210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bd9c1c2-d120-4354-a56e-110c7062a73f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:19.528761 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8430e8c9-94a7-4bde-a6e6-47389bf9f4e1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:19.529372 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8430e8c9-94a7-4bde-a6e6-47389bf9f4e1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:19.536910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8430e8c9-94a7-4bde-a6e6-47389bf9f4e1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:19.537397 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8430e8c9-94a7-4bde-a6e6-47389bf9f4e1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:19.537826 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8430e8c9-94a7-4bde-a6e6-47389bf9f4e1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:19.538553 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8430e8c9-94a7-4bde-a6e6-47389bf9f4e1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:19.539000 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8430e8c9-94a7-4bde-a6e6-47389bf9f4e1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:19.539416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8430e8c9-94a7-4bde-a6e6-47389bf9f4e1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:19.626212 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4bd9c1c2-d120-4354-a56e-110c7062a73f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:19.635110 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4bd9c1c2-d120-4354-a56e-110c7062a73f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.292204 Aug 24 16:41:19.637488 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 141/283] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:19 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:19.782565 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8430e8c9-94a7-4bde-a6e6-47389bf9f4e1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:19.796756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8430e8c9-94a7-4bde-a6e6-47389bf9f4e1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.272383 Aug 24 16:41:19.797490 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 143/284] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:19 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:19.960066 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:19.960660 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:19.966472 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:19.966950 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:19.967378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:19.968090 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:19.968536 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:19.968952 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:20.120155 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:20.129808 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:20.131640 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:20.132889 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-535cd586-9896-4d12-a50e-913ab71d857a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.176699 Aug 24 16:41:20.133503 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 142/285] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:19 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:20.657852 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d7d2c83f-5aba-4c03-b272-30c403db1378 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:20.659632 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d7d2c83f-5aba-4c03-b272-30c403db1378 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:20.665513 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7d2c83f-5aba-4c03-b272-30c403db1378 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:20.666061 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7d2c83f-5aba-4c03-b272-30c403db1378 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:20.666557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7d2c83f-5aba-4c03-b272-30c403db1378 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:20.667306 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7d2c83f-5aba-4c03-b272-30c403db1378 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:20.667759 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7d2c83f-5aba-4c03-b272-30c403db1378 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:20.668201 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7d2c83f-5aba-4c03-b272-30c403db1378 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:20.819366 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d7d2c83f-5aba-4c03-b272-30c403db1378 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:20.820759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-cf8d8e4b-70a9-4fed-a042-89d1c983f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:20.821541 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-cf8d8e4b-70a9-4fed-a042-89d1c983f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:20.828842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf8d8e4b-70a9-4fed-a042-89d1c983f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:20.829453 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf8d8e4b-70a9-4fed-a042-89d1c983f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:20.829959 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf8d8e4b-70a9-4fed-a042-89d1c983f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:20.830637 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d7d2c83f-5aba-4c03-b272-30c403db1378 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.176426 Aug 24 16:41:20.831002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf8d8e4b-70a9-4fed-a042-89d1c983f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:20.831480 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf8d8e4b-70a9-4fed-a042-89d1c983f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:20.832023 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf8d8e4b-70a9-4fed-a042-89d1c983f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:20.839826 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 144/286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:20 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:20.854092 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=100 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:20.975794 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-cf8d8e4b-70a9-4fed-a042-89d1c983f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:20.984315 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-cf8d8e4b-70a9-4fed-a042-89d1c983f60d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.169416 Aug 24 16:41:20.984777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 143/287] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:20 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:21.156935 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:21.157546 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:21.163486 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:21.164002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:21.164447 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:21.165150 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:21.165607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:21.166033 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:21.302534 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:21.311058 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:21.312809 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:21.313982 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c517156a-c426-4b52-b2e1-cff512a53e13 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.161167 Aug 24 16:41:21.315068 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 145/288] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:21 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:41:21.604901 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-007ae87c-c6c3-4dd9-aadb-b70efe40f8b1 req-a07285fd-3362-4794-b335-2fd600ad21f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd320ce6-9330-4f84-8d6e-bd6b776fe22a", "name": "network-vif-plugged", "status": "completed", "tag": "472d117d-1a7a-49b3-b8c4-207aa2b41e73"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:21.615780 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-007ae87c-c6c3-4dd9-aadb-b70efe40f8b1 req-a07285fd-3362-4794-b335-2fd600ad21f4 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:21.616716 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-007ae87c-c6c3-4dd9-aadb-b70efe40f8b1 req-a07285fd-3362-4794-b335-2fd600ad21f4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:21.617574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-007ae87c-c6c3-4dd9-aadb-b70efe40f8b1 req-a07285fd-3362-4794-b335-2fd600ad21f4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:21.631294 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-007ae87c-c6c3-4dd9-aadb-b70efe40f8b1 req-a07285fd-3362-4794-b335-2fd600ad21f4 service nova] Creating event network-vif-plugged:472d117d-1a7a-49b3-b8c4-207aa2b41e73 for instance bd320ce6-9330-4f84-8d6e-bd6b776fe22a on hv-cinder-77957 Aug 24 16:41:21.636591 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-007ae87c-c6c3-4dd9-aadb-b70efe40f8b1 req-a07285fd-3362-4794-b335-2fd600ad21f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036051 Aug 24 16:41:21.637368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 144/289] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:21.857364 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8c5b1bfe-a634-4df0-bd62-e02fe6d62b1e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:21.857976 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8c5b1bfe-a634-4df0-bd62-e02fe6d62b1e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:21.865426 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c5b1bfe-a634-4df0-bd62-e02fe6d62b1e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:21.865827 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c5b1bfe-a634-4df0-bd62-e02fe6d62b1e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:21.866293 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c5b1bfe-a634-4df0-bd62-e02fe6d62b1e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:21.867041 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c5b1bfe-a634-4df0-bd62-e02fe6d62b1e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:21.867495 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c5b1bfe-a634-4df0-bd62-e02fe6d62b1e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:21.868301 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c5b1bfe-a634-4df0-bd62-e02fe6d62b1e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:22.005363 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8c5b1bfe-a634-4df0-bd62-e02fe6d62b1e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:22.006743 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-54b1caa1-8d46-4f56-a6ee-64487ba1d873 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:22.007442 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-54b1caa1-8d46-4f56-a6ee-64487ba1d873 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:22.013532 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54b1caa1-8d46-4f56-a6ee-64487ba1d873 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:22.014219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54b1caa1-8d46-4f56-a6ee-64487ba1d873 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:22.014919 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54b1caa1-8d46-4f56-a6ee-64487ba1d873 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:22.015559 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8c5b1bfe-a634-4df0-bd62-e02fe6d62b1e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.163404 Aug 24 16:41:22.015782 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54b1caa1-8d46-4f56-a6ee-64487ba1d873 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:22.016139 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54b1caa1-8d46-4f56-a6ee-64487ba1d873 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:22.016270 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 146/290] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:21 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:22.016554 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-54b1caa1-8d46-4f56-a6ee-64487ba1d873 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:22.163459 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-54b1caa1-8d46-4f56-a6ee-64487ba1d873 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:22.171132 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-54b1caa1-8d46-4f56-a6ee-64487ba1d873 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.169139 Aug 24 16:41:22.171777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 145/291] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:22 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:22.339584 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:22.340159 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:22.346046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:22.346525 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:22.346947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:22.347622 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:22.348265 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:22.348681 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:22.500229 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:22.519999 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:22.521519 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:22.522908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-96ae2a8f-86a3-4631-be9e-9620db32d421 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.187261 Aug 24 16:41:22.523555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 147/292] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:22 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:23.037553 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-bf5aed81-53a4-49b6-b81c-d000fa450abc tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:23.037924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-bf5aed81-53a4-49b6-b81c-d000fa450abc tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:23.044206 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bf5aed81-53a4-49b6-b81c-d000fa450abc tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:23.044712 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bf5aed81-53a4-49b6-b81c-d000fa450abc tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:23.045146 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bf5aed81-53a4-49b6-b81c-d000fa450abc tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:23.045915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bf5aed81-53a4-49b6-b81c-d000fa450abc tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:23.046414 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bf5aed81-53a4-49b6-b81c-d000fa450abc tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:23.046855 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bf5aed81-53a4-49b6-b81c-d000fa450abc tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:23.195870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fbd6077c-b5a6-4bef-a0fd-39f6f19286cf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:23.195870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fbd6077c-b5a6-4bef-a0fd-39f6f19286cf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:23.201330 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbd6077c-b5a6-4bef-a0fd-39f6f19286cf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:23.202060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbd6077c-b5a6-4bef-a0fd-39f6f19286cf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:23.202814 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbd6077c-b5a6-4bef-a0fd-39f6f19286cf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:23.204133 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbd6077c-b5a6-4bef-a0fd-39f6f19286cf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:23.204602 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbd6077c-b5a6-4bef-a0fd-39f6f19286cf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:23.205106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbd6077c-b5a6-4bef-a0fd-39f6f19286cf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:23.216728 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-bf5aed81-53a4-49b6-b81c-d000fa450abc tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:23.229109 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-bf5aed81-53a4-49b6-b81c-d000fa450abc tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.195091 Aug 24 16:41:23.229917 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 146/293] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:23 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:23.351098 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fbd6077c-b5a6-4bef-a0fd-39f6f19286cf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:23.358700 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-fbd6077c-b5a6-4bef-a0fd-39f6f19286cf tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.169684 Aug 24 16:41:23.359438 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 148/294] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:23 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:23.550955 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:23.551797 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:23.557908 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:23.558465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:23.558960 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:23.560014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:23.560682 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:23.561161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:23.743914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:23.753662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:23.755447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:23.756638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-bed26bc0-308a-4568-8e5e-543e96ff73c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.213224 Aug 24 16:41:23.757512 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 147/295] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:23 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:24.250396 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ea21e3ae-22a9-40b2-983c-142b9f6bf59b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:24.251009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ea21e3ae-22a9-40b2-983c-142b9f6bf59b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:24.257872 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea21e3ae-22a9-40b2-983c-142b9f6bf59b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:24.258359 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea21e3ae-22a9-40b2-983c-142b9f6bf59b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:24.258789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea21e3ae-22a9-40b2-983c-142b9f6bf59b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:24.259582 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea21e3ae-22a9-40b2-983c-142b9f6bf59b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:24.260212 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea21e3ae-22a9-40b2-983c-142b9f6bf59b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:24.260637 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea21e3ae-22a9-40b2-983c-142b9f6bf59b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:24.381379 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e587fb9f-31ef-450a-80b3-5c621a1649ef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:24.381967 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e587fb9f-31ef-450a-80b3-5c621a1649ef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:24.388503 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e587fb9f-31ef-450a-80b3-5c621a1649ef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:24.389184 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e587fb9f-31ef-450a-80b3-5c621a1649ef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:24.389612 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e587fb9f-31ef-450a-80b3-5c621a1649ef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:24.390324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e587fb9f-31ef-450a-80b3-5c621a1649ef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:24.390925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e587fb9f-31ef-450a-80b3-5c621a1649ef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:24.391501 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e587fb9f-31ef-450a-80b3-5c621a1649ef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:24.398710 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ea21e3ae-22a9-40b2-983c-142b9f6bf59b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:24.406369 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ea21e3ae-22a9-40b2-983c-142b9f6bf59b tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.159782 Aug 24 16:41:24.406929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 149/296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:24 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:24.544181 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e587fb9f-31ef-450a-80b3-5c621a1649ef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:24.553873 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e587fb9f-31ef-450a-80b3-5c621a1649ef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.177059 Aug 24 16:41:24.554436 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 148/297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:24 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:24.780708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:24.781314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:24.783294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:24.792802 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:24.793499 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:24.793933 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:24.794630 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:24.795083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:24.795520 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:24.934022 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:24.944784 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:24.946177 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:24.947347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d9acbd31-f5f7-4359-83b2-a29d2eb9d35d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.170714 Aug 24 16:41:24.947902 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 150/298] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:24 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:25.427659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e12c7a1a-d467-4a3e-868d-628aedb90859 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:25.428331 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e12c7a1a-d467-4a3e-868d-628aedb90859 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:25.434795 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e12c7a1a-d467-4a3e-868d-628aedb90859 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:25.435311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e12c7a1a-d467-4a3e-868d-628aedb90859 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:25.435741 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e12c7a1a-d467-4a3e-868d-628aedb90859 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:25.436459 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e12c7a1a-d467-4a3e-868d-628aedb90859 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:25.436914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e12c7a1a-d467-4a3e-868d-628aedb90859 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:25.437576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e12c7a1a-d467-4a3e-868d-628aedb90859 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:25.575410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f8fb3cc2-5c11-4748-90af-e6e9b1ccf7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:25.576038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f8fb3cc2-5c11-4748-90af-e6e9b1ccf7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:25.576557 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e12c7a1a-d467-4a3e-868d-628aedb90859 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:25.583145 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8fb3cc2-5c11-4748-90af-e6e9b1ccf7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:25.584593 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8fb3cc2-5c11-4748-90af-e6e9b1ccf7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:25.585044 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8fb3cc2-5c11-4748-90af-e6e9b1ccf7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:25.585941 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8fb3cc2-5c11-4748-90af-e6e9b1ccf7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:25.586078 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e12c7a1a-d467-4a3e-868d-628aedb90859 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.162966 Aug 24 16:41:25.586433 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8fb3cc2-5c11-4748-90af-e6e9b1ccf7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:25.586864 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8fb3cc2-5c11-4748-90af-e6e9b1ccf7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:25.588108 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 149/299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:25 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:25.724017 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f8fb3cc2-5c11-4748-90af-e6e9b1ccf7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:25.731937 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f8fb3cc2-5c11-4748-90af-e6e9b1ccf7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.160311 Aug 24 16:41:25.732778 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 151/300] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:25 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:25.976240 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:25.976850 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:25.982703 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:25.983185 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:25.983620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:25.984342 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:25.984802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:25.985228 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:26.131729 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:26.140940 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:26.142482 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:26.143865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6072af74-68b3-4b62-9fdc-874fa9da2d9f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.172434 Aug 24 16:41:26.160009 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 150/301] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:25 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:26.608338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-013909a6-1d30-48ad-9e8a-23617c1e4aa4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:26.608962 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-013909a6-1d30-48ad-9e8a-23617c1e4aa4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:26.614879 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-013909a6-1d30-48ad-9e8a-23617c1e4aa4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:26.615349 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-013909a6-1d30-48ad-9e8a-23617c1e4aa4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:26.615769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-013909a6-1d30-48ad-9e8a-23617c1e4aa4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:26.616465 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-013909a6-1d30-48ad-9e8a-23617c1e4aa4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:26.616910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-013909a6-1d30-48ad-9e8a-23617c1e4aa4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:26.617391 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-013909a6-1d30-48ad-9e8a-23617c1e4aa4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:26.631636 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=100 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:26.745470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-013909a6-1d30-48ad-9e8a-23617c1e4aa4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:26.753627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-013909a6-1d30-48ad-9e8a-23617c1e4aa4 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.149128 Aug 24 16:41:26.754201 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 152/302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:26 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:26.754471 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8734b86f-d40a-4a63-bb8a-736ae158ac2a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:26.755086 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8734b86f-d40a-4a63-bb8a-736ae158ac2a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:26.761790 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8734b86f-d40a-4a63-bb8a-736ae158ac2a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:26.762276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8734b86f-d40a-4a63-bb8a-736ae158ac2a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:26.762708 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8734b86f-d40a-4a63-bb8a-736ae158ac2a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:26.763427 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8734b86f-d40a-4a63-bb8a-736ae158ac2a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:26.763911 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8734b86f-d40a-4a63-bb8a-736ae158ac2a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:26.764357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8734b86f-d40a-4a63-bb8a-736ae158ac2a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:26.901986 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8734b86f-d40a-4a63-bb8a-736ae158ac2a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:26.915873 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8734b86f-d40a-4a63-bb8a-736ae158ac2a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.165551 Aug 24 16:41:26.916463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 151/303] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:26 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:27.166657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:27.167191 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:27.173089 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:27.174157 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:27.174741 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:27.175426 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:27.175881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:27.176337 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:27.307813 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:27.315843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:27.317374 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:27.318509 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ac0c92e2-b2a8-40df-afd0-f9ccd7d584c1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.155883 Aug 24 16:41:27.319041 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 153/304] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:27 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:27.774542 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8651d65f-bf99-4a8c-8eb2-eda902ded4a0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:27.775147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8651d65f-bf99-4a8c-8eb2-eda902ded4a0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:27.781651 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8651d65f-bf99-4a8c-8eb2-eda902ded4a0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:27.782130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8651d65f-bf99-4a8c-8eb2-eda902ded4a0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:27.782558 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8651d65f-bf99-4a8c-8eb2-eda902ded4a0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:27.783853 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8651d65f-bf99-4a8c-8eb2-eda902ded4a0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:27.784424 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8651d65f-bf99-4a8c-8eb2-eda902ded4a0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:27.784759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8651d65f-bf99-4a8c-8eb2-eda902ded4a0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:27.912430 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8651d65f-bf99-4a8c-8eb2-eda902ded4a0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:27.919868 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8651d65f-bf99-4a8c-8eb2-eda902ded4a0 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.149234 Aug 24 16:41:27.920450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 152/305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:27 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:27.938271 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-da7e2a05-8bbb-4d3f-a944-567dc5448caa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:27.938886 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-da7e2a05-8bbb-4d3f-a944-567dc5448caa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:27.945661 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da7e2a05-8bbb-4d3f-a944-567dc5448caa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:27.946150 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da7e2a05-8bbb-4d3f-a944-567dc5448caa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:27.946590 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da7e2a05-8bbb-4d3f-a944-567dc5448caa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:27.947314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da7e2a05-8bbb-4d3f-a944-567dc5448caa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:27.947770 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da7e2a05-8bbb-4d3f-a944-567dc5448caa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:27.948244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da7e2a05-8bbb-4d3f-a944-567dc5448caa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:28.082182 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-da7e2a05-8bbb-4d3f-a944-567dc5448caa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:28.089792 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-da7e2a05-8bbb-4d3f-a944-567dc5448caa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.155249 Aug 24 16:41:28.090357 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 154/306] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:27 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:28.341777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:28.342393 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:28.348354 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:28.348844 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:28.349278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:28.349986 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:28.350764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:28.350879 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:28.478766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:28.489772 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:28.491295 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:28.492464 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-135b1269-4ce6-4188-a6a7-70e97ab19817 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.154634 Aug 24 16:41:28.493018 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 153/307] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:28 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:28.941270 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1a91e65f-fe9f-4778-b8eb-70ecf5c3f6bd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:28.941826 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1a91e65f-fe9f-4778-b8eb-70ecf5c3f6bd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:28.948245 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1a91e65f-fe9f-4778-b8eb-70ecf5c3f6bd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:28.948724 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1a91e65f-fe9f-4778-b8eb-70ecf5c3f6bd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:28.949156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1a91e65f-fe9f-4778-b8eb-70ecf5c3f6bd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:28.949845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1a91e65f-fe9f-4778-b8eb-70ecf5c3f6bd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:28.950292 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1a91e65f-fe9f-4778-b8eb-70ecf5c3f6bd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:28.950707 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1a91e65f-fe9f-4778-b8eb-70ecf5c3f6bd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:29.110022 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-bdeaebf9-9fb5-4046-ad0a-756c09470c47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:29.110878 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-bdeaebf9-9fb5-4046-ad0a-756c09470c47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:29.117663 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bdeaebf9-9fb5-4046-ad0a-756c09470c47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:29.118226 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bdeaebf9-9fb5-4046-ad0a-756c09470c47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:29.118669 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bdeaebf9-9fb5-4046-ad0a-756c09470c47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:29.119365 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bdeaebf9-9fb5-4046-ad0a-756c09470c47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:29.120143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bdeaebf9-9fb5-4046-ad0a-756c09470c47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:29.120408 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bdeaebf9-9fb5-4046-ad0a-756c09470c47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:29.130413 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1a91e65f-fe9f-4778-b8eb-70ecf5c3f6bd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:29.139083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1a91e65f-fe9f-4778-b8eb-70ecf5c3f6bd tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1314 microversion: 2.1 time: 0.201937 Aug 24 16:41:29.144561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 155/308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:28 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:29.267802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-bdeaebf9-9fb5-4046-ad0a-756c09470c47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:29.276054 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-bdeaebf9-9fb5-4046-ad0a-756c09470c47 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.169795 Aug 24 16:41:29.276703 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 154/309] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:29 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:29.514548 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:29.515150 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:29.523528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:29.524265 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:29.524866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:29.525984 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:29.526760 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:29.527184 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:29.671701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:29.680969 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:29.682593 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:29.683923 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5f12d732-e5f9-4f26-bd56-97b0461ae932 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.173303 Aug 24 16:41:29.684543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 156/310] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:29 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:30.161395 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f5f49f2c-ddd5-4d59-8112-91fe8db99f64 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:30.162009 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f5f49f2c-ddd5-4d59-8112-91fe8db99f64 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:30.169933 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f5f49f2c-ddd5-4d59-8112-91fe8db99f64 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:30.170443 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f5f49f2c-ddd5-4d59-8112-91fe8db99f64 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:30.170859 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f5f49f2c-ddd5-4d59-8112-91fe8db99f64 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:30.171553 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f5f49f2c-ddd5-4d59-8112-91fe8db99f64 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:30.172098 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f5f49f2c-ddd5-4d59-8112-91fe8db99f64 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:30.172554 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f5f49f2c-ddd5-4d59-8112-91fe8db99f64 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:30.299100 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f1ff4213-fed9-4216-a54e-5e798aded486 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:30.299828 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f1ff4213-fed9-4216-a54e-5e798aded486 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:30.305807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f1ff4213-fed9-4216-a54e-5e798aded486 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:30.306295 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f1ff4213-fed9-4216-a54e-5e798aded486 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:30.306731 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f1ff4213-fed9-4216-a54e-5e798aded486 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:30.307419 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f1ff4213-fed9-4216-a54e-5e798aded486 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:30.307862 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f1ff4213-fed9-4216-a54e-5e798aded486 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:30.308318 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f1ff4213-fed9-4216-a54e-5e798aded486 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:30.320583 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f5f49f2c-ddd5-4d59-8112-91fe8db99f64 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:30.328810 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f5f49f2c-ddd5-4d59-8112-91fe8db99f64 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1498 microversion: 2.1 time: 0.171842 Aug 24 16:41:30.329370 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 155/311] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:30 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:30.448904 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f1ff4213-fed9-4216-a54e-5e798aded486 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:30.457404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f1ff4213-fed9-4216-a54e-5e798aded486 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.162641 Aug 24 16:41:30.457982 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 157/312] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:30 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:30.707614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:30.708232 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:30.717688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:30.717688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:30.717688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:30.717688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:30.718105 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:30.718105 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:30.851125 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:30.859099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:30.860644 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:30.862313 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-28114a45-0322-44db-adce-8374531acfe8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.159574 Aug 24 16:41:30.862897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 156/313] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:30 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:31.479677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2afb17a1-becc-46b6-9d23-4b524954efd0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:31.480329 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2afb17a1-becc-46b6-9d23-4b524954efd0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:31.487516 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2afb17a1-becc-46b6-9d23-4b524954efd0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:31.488020 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2afb17a1-becc-46b6-9d23-4b524954efd0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:31.488457 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2afb17a1-becc-46b6-9d23-4b524954efd0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:31.489147 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2afb17a1-becc-46b6-9d23-4b524954efd0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:31.489602 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2afb17a1-becc-46b6-9d23-4b524954efd0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:31.490020 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2afb17a1-becc-46b6-9d23-4b524954efd0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:31.621612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2afb17a1-becc-46b6-9d23-4b524954efd0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:31.629318 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2afb17a1-becc-46b6-9d23-4b524954efd0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.153660 Aug 24 16:41:31.629878 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 158/314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:31 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:31.884835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:31.885446 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:31.891970 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:31.893249 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:31.893690 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:31.894402 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:31.894860 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:31.895284 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:32.026836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:32.036290 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:32.038069 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:32.039223 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6d7aae3a-0983-4b41-8c3e-6276a801e06c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.158241 Aug 24 16:41:32.039770 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 157/315] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:31 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:32.650035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-85547994-4232-4e49-a1f7-b294f851dcd3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:32.650640 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-85547994-4232-4e49-a1f7-b294f851dcd3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:32.656859 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85547994-4232-4e49-a1f7-b294f851dcd3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:32.657333 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85547994-4232-4e49-a1f7-b294f851dcd3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:32.658066 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85547994-4232-4e49-a1f7-b294f851dcd3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:32.659251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85547994-4232-4e49-a1f7-b294f851dcd3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:32.659720 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85547994-4232-4e49-a1f7-b294f851dcd3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:32.660167 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85547994-4232-4e49-a1f7-b294f851dcd3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:32.786879 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-85547994-4232-4e49-a1f7-b294f851dcd3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:32.794802 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-85547994-4232-4e49-a1f7-b294f851dcd3 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.148503 Aug 24 16:41:32.795352 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 159/316] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:32 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:33.062362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:33.062965 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:33.070450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:33.070937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:33.071363 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:33.072080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:33.072535 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:33.072952 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:33.207902 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:33.216079 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:33.217581 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:33.218721 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c518923b-fd8d-4a2f-b5e6-6d18092c4b17 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.160362 Aug 24 16:41:33.219262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 158/317] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:33 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:33.816371 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9f6081b4-8089-425c-bbc0-6690abfd8f00 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:33.816987 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9f6081b4-8089-425c-bbc0-6690abfd8f00 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:33.828169 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f6081b4-8089-425c-bbc0-6690abfd8f00 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:33.828658 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f6081b4-8089-425c-bbc0-6690abfd8f00 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:33.829090 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f6081b4-8089-425c-bbc0-6690abfd8f00 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:33.830563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f6081b4-8089-425c-bbc0-6690abfd8f00 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:33.831123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f6081b4-8089-425c-bbc0-6690abfd8f00 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:33.831546 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f6081b4-8089-425c-bbc0-6690abfd8f00 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:33.977766 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9f6081b4-8089-425c-bbc0-6690abfd8f00 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:33.983473 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9f6081b4-8089-425c-bbc0-6690abfd8f00 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.171431 Aug 24 16:41:33.984205 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 160/318] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:33 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:34.243910 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:34.245340 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:34.255259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:34.255823 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:34.256420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:34.257119 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:34.257799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:34.258112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:34.403987 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:34.416127 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:34.417692 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:34.418838 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-bb6550b7-049a-409c-b029-35b9f5b9d038 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.180241 Aug 24 16:41:34.419381 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 159/319] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:34 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:35.005312 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f98c7076-cd4e-4a0c-978c-61f0f0d98d69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:35.005996 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f98c7076-cd4e-4a0c-978c-61f0f0d98d69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:35.012880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f98c7076-cd4e-4a0c-978c-61f0f0d98d69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:35.013376 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f98c7076-cd4e-4a0c-978c-61f0f0d98d69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:35.013813 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f98c7076-cd4e-4a0c-978c-61f0f0d98d69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:35.014519 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f98c7076-cd4e-4a0c-978c-61f0f0d98d69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:35.014977 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f98c7076-cd4e-4a0c-978c-61f0f0d98d69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:35.015403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f98c7076-cd4e-4a0c-978c-61f0f0d98d69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:35.149297 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f98c7076-cd4e-4a0c-978c-61f0f0d98d69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:35.157277 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f98c7076-cd4e-4a0c-978c-61f0f0d98d69 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.157127 Aug 24 16:41:35.159047 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 161/320] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:34 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:35.443885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:35.444519 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:35.455417 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:35.455896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:35.456828 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:35.457289 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:35.457742 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:35.458161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:35.604217 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:35.607805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=100 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:35.613871 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:35.615414 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:35.616620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-50b00b2b-d5ce-4a99-83bc-3ffebc665935 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.177927 Aug 24 16:41:35.617176 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 160/321] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:35 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:36.179674 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9cc5fbff-2004-4df5-9f91-3e84babb6940 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:36.180277 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9cc5fbff-2004-4df5-9f91-3e84babb6940 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:36.186105 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbff-2004-4df5-9f91-3e84babb6940 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:36.186585 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbff-2004-4df5-9f91-3e84babb6940 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:36.187010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbff-2004-4df5-9f91-3e84babb6940 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:36.187684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbff-2004-4df5-9f91-3e84babb6940 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:36.188162 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbff-2004-4df5-9f91-3e84babb6940 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:36.188577 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbff-2004-4df5-9f91-3e84babb6940 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:36.320549 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9cc5fbff-2004-4df5-9f91-3e84babb6940 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:36.328112 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9cc5fbff-2004-4df5-9f91-3e84babb6940 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.152254 Aug 24 16:41:36.328671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 162/322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:36 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:36.645091 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:36.645708 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:36.652583 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:36.653066 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:36.653497 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:36.654210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:36.654661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:36.655080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:36.789650 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:36.797760 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:36.799447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:36.800638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-5540500e-1907-4a48-9865-b71476e7bc12 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.161069 Aug 24 16:41:36.801199 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 161/323] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:36 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:37.092596 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-89b8d95b-8aa9-41c3-ba96-ec0d0f0a2989 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:37.093048 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-89b8d95b-8aa9-41c3-ba96-ec0d0f0a2989 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:37.107438 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89b8d95b-8aa9-41c3-ba96-ec0d0f0a2989 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:37.107958 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89b8d95b-8aa9-41c3-ba96-ec0d0f0a2989 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:37.108405 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89b8d95b-8aa9-41c3-ba96-ec0d0f0a2989 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:37.109112 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89b8d95b-8aa9-41c3-ba96-ec0d0f0a2989 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:37.109565 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89b8d95b-8aa9-41c3-ba96-ec0d0f0a2989 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:37.110522 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89b8d95b-8aa9-41c3-ba96-ec0d0f0a2989 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:37.138424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-89b8d95b-8aa9-41c3-ba96-ec0d0f0a2989 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Going to try to terminate instance {{(pid=127166) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:41:37.218888 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-89b8d95b-8aa9-41c3-ba96-ec0d0f0a2989 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 204 len: 0 microversion: 2.1 time: 0.129995 Aug 24 16:41:37.219540 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 163/324] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:41:37 2022] DELETE /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:41:37.228841 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f6f6e09d-37b2-4409-8a6c-93bcc60c94e9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:37.229687 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f6f6e09d-37b2-4409-8a6c-93bcc60c94e9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:37.238646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6f6e09d-37b2-4409-8a6c-93bcc60c94e9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:37.239244 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6f6e09d-37b2-4409-8a6c-93bcc60c94e9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:37.239722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6f6e09d-37b2-4409-8a6c-93bcc60c94e9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:37.240557 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6f6e09d-37b2-4409-8a6c-93bcc60c94e9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:37.241019 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6f6e09d-37b2-4409-8a6c-93bcc60c94e9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:37.241447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6f6e09d-37b2-4409-8a6c-93bcc60c94e9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:37.351745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1d8bb37d-4f24-4395-8500-92b0727c280f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:37.352263 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1d8bb37d-4f24-4395-8500-92b0727c280f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:37.363928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d8bb37d-4f24-4395-8500-92b0727c280f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:37.364691 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d8bb37d-4f24-4395-8500-92b0727c280f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:37.365200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d8bb37d-4f24-4395-8500-92b0727c280f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:37.365996 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d8bb37d-4f24-4395-8500-92b0727c280f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:37.366680 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d8bb37d-4f24-4395-8500-92b0727c280f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:37.367574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d8bb37d-4f24-4395-8500-92b0727c280f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:37.433136 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f6f6e09d-37b2-4409-8a6c-93bcc60c94e9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:37.441271 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f6f6e09d-37b2-4409-8a6c-93bcc60c94e9 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1504 microversion: 2.1 time: 0.216956 Aug 24 16:41:37.442028 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 162/325] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:37 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:37.530837 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1d8bb37d-4f24-4395-8500-92b0727c280f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:37.540308 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1d8bb37d-4f24-4395-8500-92b0727c280f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.194568 Aug 24 16:41:37.540978 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 164/326] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:37 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:37.824478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:37.825098 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:37.831914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:37.832426 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:37.832857 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:37.833550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:37.834003 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:37.834423 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:37.979266 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:37.988904 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:37.990450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:37.991608 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-26246f2e-33a0-4321-a83c-35d0e892c498 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.171060 Aug 24 16:41:37.992184 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 163/327] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:37 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:38.462948 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f5b5222f-e061-4a34-9511-30efdb55cec6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:38.463866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f5b5222f-e061-4a34-9511-30efdb55cec6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:38.472102 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5b5222f-e061-4a34-9511-30efdb55cec6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:38.472993 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5b5222f-e061-4a34-9511-30efdb55cec6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:38.473721 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5b5222f-e061-4a34-9511-30efdb55cec6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:38.475009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5b5222f-e061-4a34-9511-30efdb55cec6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:38.475827 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5b5222f-e061-4a34-9511-30efdb55cec6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:38.476594 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5b5222f-e061-4a34-9511-30efdb55cec6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:38.561840 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-915c8611-b48d-4051-9f18-77280510fc9a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:38.562447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-915c8611-b48d-4051-9f18-77280510fc9a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:38.568970 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-915c8611-b48d-4051-9f18-77280510fc9a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:38.569450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-915c8611-b48d-4051-9f18-77280510fc9a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:38.569880 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-915c8611-b48d-4051-9f18-77280510fc9a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:38.570563 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-915c8611-b48d-4051-9f18-77280510fc9a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:38.571011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-915c8611-b48d-4051-9f18-77280510fc9a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:38.571430 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-915c8611-b48d-4051-9f18-77280510fc9a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:38.623627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f5b5222f-e061-4a34-9511-30efdb55cec6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:38.632274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f5b5222f-e061-4a34-9511-30efdb55cec6 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1504 microversion: 2.1 time: 0.173805 Aug 24 16:41:38.632963 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 165/328] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:38 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:38.720623 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-915c8611-b48d-4051-9f18-77280510fc9a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:38.733114 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-915c8611-b48d-4051-9f18-77280510fc9a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.174983 Aug 24 16:41:38.733691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 164/329] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:38 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:39.020132 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:39.020753 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:39.034985 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:39.035488 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:39.035935 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:39.040142 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:39.040731 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:39.045177 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:39.368204 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:39.378932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:39.380804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:39.382255 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d64bbe77-81eb-4eb6-90f9-bea36c45a9bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1742 microversion: 2.20 time: 0.370076 Aug 24 16:41:39.396440 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 166/330] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:39 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1742 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:39.654976 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c7d56f48-a2b5-4b8c-8dac-5bebab5a835f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:39.657769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c7d56f48-a2b5-4b8c-8dac-5bebab5a835f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:39.665379 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7d56f48-a2b5-4b8c-8dac-5bebab5a835f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:39.666120 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7d56f48-a2b5-4b8c-8dac-5bebab5a835f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:39.666803 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7d56f48-a2b5-4b8c-8dac-5bebab5a835f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:39.667885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7d56f48-a2b5-4b8c-8dac-5bebab5a835f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:39.668247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7d56f48-a2b5-4b8c-8dac-5bebab5a835f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:39.668564 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7d56f48-a2b5-4b8c-8dac-5bebab5a835f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:39.758005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-815483f5-d653-4adc-87e6-669b3095d63d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:39.758442 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-815483f5-d653-4adc-87e6-669b3095d63d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:39.768533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-815483f5-d653-4adc-87e6-669b3095d63d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:39.770491 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-815483f5-d653-4adc-87e6-669b3095d63d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:39.771299 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-815483f5-d653-4adc-87e6-669b3095d63d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:39.773586 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-815483f5-d653-4adc-87e6-669b3095d63d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:39.774910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-815483f5-d653-4adc-87e6-669b3095d63d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:39.775561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-815483f5-d653-4adc-87e6-669b3095d63d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:39.800287 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:40.246069 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c7d56f48-a2b5-4b8c-8dac-5bebab5a835f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:40.260443 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c7d56f48-a2b5-4b8c-8dac-5bebab5a835f tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1504 microversion: 2.1 time: 0.610306 Aug 24 16:41:40.272509 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 165/331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:39 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1504 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:40.396659 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-815483f5-d653-4adc-87e6-669b3095d63d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:40.408651 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:40.409417 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:40.412491 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-815483f5-d653-4adc-87e6-669b3095d63d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.658207 Aug 24 16:41:40.414561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 167/332] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:39 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:41:40.421901 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:40.429146 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:40.429146 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:40.429146 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:40.429146 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:40.429500 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:40.664446 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-124af684-5e71-4eea-ad2b-c5b02bb8542b req-8603cd8f-f3bb-45ee-b6b2-2bb4e3f4a259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd320ce6-9330-4f84-8d6e-bd6b776fe22a", "name": "network-vif-deleted", "tag": "472d117d-1a7a-49b3-b8c4-207aa2b41e73"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:40.705146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-124af684-5e71-4eea-ad2b-c5b02bb8542b req-8603cd8f-f3bb-45ee-b6b2-2bb4e3f4a259 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:40.705945 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-124af684-5e71-4eea-ad2b-c5b02bb8542b req-8603cd8f-f3bb-45ee-b6b2-2bb4e3f4a259 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:40.706574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-124af684-5e71-4eea-ad2b-c5b02bb8542b req-8603cd8f-f3bb-45ee-b6b2-2bb4e3f4a259 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:40.741056 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-124af684-5e71-4eea-ad2b-c5b02bb8542b req-8603cd8f-f3bb-45ee-b6b2-2bb4e3f4a259 service nova] Creating event network-vif-deleted:472d117d-1a7a-49b3-b8c4-207aa2b41e73 for instance bd320ce6-9330-4f84-8d6e-bd6b776fe22a on hv-cinder-77957 Aug 24 16:41:40.755150 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-124af684-5e71-4eea-ad2b-c5b02bb8542b req-8603cd8f-f3bb-45ee-b6b2-2bb4e3f4a259 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092323 Aug 24 16:41:40.756394 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 168/333] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:40.781226 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:40.794060 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:40.795829 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:40.797230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2b8427fe-25fd-4a7a-85dd-27cf1841924f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1742 microversion: 2.20 time: 0.393006 Aug 24 16:41:40.798193 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 166/334] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:40 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1742 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:41:41.287317 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5d07b787-b19d-463b-ab2c-844f3139ddf1 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:41.288141 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5d07b787-b19d-463b-ab2c-844f3139ddf1 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:41.296545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5d07b787-b19d-463b-ab2c-844f3139ddf1 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:41.297034 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5d07b787-b19d-463b-ab2c-844f3139ddf1 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:41.297671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5d07b787-b19d-463b-ab2c-844f3139ddf1 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:41.299190 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5d07b787-b19d-463b-ab2c-844f3139ddf1 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:41.300003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5d07b787-b19d-463b-ab2c-844f3139ddf1 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:41.300586 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5d07b787-b19d-463b-ab2c-844f3139ddf1 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:41.386235 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5d07b787-b19d-463b-ab2c-844f3139ddf1 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:41.406833 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5d07b787-b19d-463b-ab2c-844f3139ddf1 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1462 microversion: 2.1 time: 0.126731 Aug 24 16:41:41.408243 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 169/335] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:41 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1462 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:41.442232 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-10c5ee34-c4c3-45f9-a7cc-5791d684747f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:41.442838 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-10c5ee34-c4c3-45f9-a7cc-5791d684747f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:41.448853 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-10c5ee34-c4c3-45f9-a7cc-5791d684747f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:41.449516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-10c5ee34-c4c3-45f9-a7cc-5791d684747f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:41.449947 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-10c5ee34-c4c3-45f9-a7cc-5791d684747f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:41.450645 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-10c5ee34-c4c3-45f9-a7cc-5791d684747f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:41.451100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-10c5ee34-c4c3-45f9-a7cc-5791d684747f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:41.451522 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-10c5ee34-c4c3-45f9-a7cc-5791d684747f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:41.588305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-10c5ee34-c4c3-45f9-a7cc-5791d684747f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:41.597056 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-10c5ee34-c4c3-45f9-a7cc-5791d684747f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.159210 Aug 24 16:41:41.597626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 167/336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:41 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:41.822424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:41.822949 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:41.828977 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:41.830026 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:41.830450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:41.831130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:41.831577 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:41.832026 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:42.094157 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:42.102222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:42.103695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:42.104868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-cfd244fd-8fa4-4777-ae19-e9867480f9c0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1742 microversion: 2.20 time: 0.286392 Aug 24 16:41:42.105410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 170/337] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:41 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1742 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:42.429974 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6d324b68-5f71-48e2-b665-45cac1265d99 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:42.430571 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6d324b68-5f71-48e2-b665-45cac1265d99 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:42.436923 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d324b68-5f71-48e2-b665-45cac1265d99 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:42.437410 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d324b68-5f71-48e2-b665-45cac1265d99 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:42.438039 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d324b68-5f71-48e2-b665-45cac1265d99 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:42.439383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d324b68-5f71-48e2-b665-45cac1265d99 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:42.440074 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d324b68-5f71-48e2-b665-45cac1265d99 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:42.440505 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6d324b68-5f71-48e2-b665-45cac1265d99 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:42.520580 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6d324b68-5f71-48e2-b665-45cac1265d99 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:42.528385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6d324b68-5f71-48e2-b665-45cac1265d99 tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1462 microversion: 2.1 time: 0.102278 Aug 24 16:41:42.528949 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 168/338] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:42 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1462 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:42.617490 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-052d17ef-0420-46e8-816a-75c07a74a957 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:42.618035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-052d17ef-0420-46e8-816a-75c07a74a957 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:42.623893 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-052d17ef-0420-46e8-816a-75c07a74a957 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:42.624413 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-052d17ef-0420-46e8-816a-75c07a74a957 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:42.624849 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-052d17ef-0420-46e8-816a-75c07a74a957 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:42.625540 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-052d17ef-0420-46e8-816a-75c07a74a957 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:42.626017 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-052d17ef-0420-46e8-816a-75c07a74a957 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:42.626449 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-052d17ef-0420-46e8-816a-75c07a74a957 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:42.756825 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-052d17ef-0420-46e8-816a-75c07a74a957 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:42.764329 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-052d17ef-0420-46e8-816a-75c07a74a957 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.150669 Aug 24 16:41:42.764878 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 171/339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:42 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:43.129398 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:43.130001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:43.135923 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:43.136429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:43.136880 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:43.137557 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:43.138008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:43.138430 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:43.266661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:43.275455 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:43.277251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:43.278395 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d331377a-7bc4-4ba9-9c5b-605b80a79dcf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1742 microversion: 2.20 time: 0.154202 Aug 24 16:41:43.278952 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 169/340] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:43 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:43.549989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0c0cc2b9-cac3-4a5a-ba74-c140373eafea tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:43.550594 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0c0cc2b9-cac3-4a5a-ba74-c140373eafea tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:43.556526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0cc2b9-cac3-4a5a-ba74-c140373eafea tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:43.557011 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0cc2b9-cac3-4a5a-ba74-c140373eafea tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:43.557447 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0cc2b9-cac3-4a5a-ba74-c140373eafea tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:43.558135 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0cc2b9-cac3-4a5a-ba74-c140373eafea tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:43.558590 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0cc2b9-cac3-4a5a-ba74-c140373eafea tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:43.559011 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0cc2b9-cac3-4a5a-ba74-c140373eafea tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:43.620040 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0c0cc2b9-cac3-4a5a-ba74-c140373eafea tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4b36e6959444273872c300742d6ddb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8424741e1d154c6c9b08b19fb7c61d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:43.628461 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0c0cc2b9-cac3-4a5a-ba74-c140373eafea tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 200 len: 1462 microversion: 2.1 time: 0.082707 Aug 24 16:41:43.629023 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 172/341] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:43 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:43.788157 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d6036859-d232-43b0-8caf-d9b1d232f424 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:43.788688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d6036859-d232-43b0-8caf-d9b1d232f424 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:43.795279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d6036859-d232-43b0-8caf-d9b1d232f424 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:43.795762 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d6036859-d232-43b0-8caf-d9b1d232f424 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:43.796232 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d6036859-d232-43b0-8caf-d9b1d232f424 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:43.796922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d6036859-d232-43b0-8caf-d9b1d232f424 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:43.797378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d6036859-d232-43b0-8caf-d9b1d232f424 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:43.797798 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d6036859-d232-43b0-8caf-d9b1d232f424 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:43.953016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d6036859-d232-43b0-8caf-d9b1d232f424 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:43.961456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d6036859-d232-43b0-8caf-d9b1d232f424 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.177282 Aug 24 16:41:43.962022 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 170/342] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:43 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:44.301659 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:44.302262 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:44.308702 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:44.309246 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:44.309713 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:44.310427 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:44.310886 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:44.311306 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:44.446022 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:44.457064 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:44.458800 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:44.460260 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c832d3a1-68da-42da-a93b-44dfd05f953d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1742 microversion: 2.20 time: 0.162969 Aug 24 16:41:44.460934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 173/343] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:44 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:44.648471 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:44.648995 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] [instance: bd320ce6-9330-4f84-8d6e-bd6b776fe22a] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:44.655219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:44.655706 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:44.656172 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:44.656922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:44.657475 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:44.657870 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:44.671223 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] HTTP exception thrown: Instance bd320ce6-9330-4f84-8d6e-bd6b776fe22a could not be found. Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Request method failure captured: Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a HTTP/1.1 Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlSG5F2o5L4HLpIcAc3L2EYRvJBH2tig01MmeKXgzVtW43s5axfnrEakQoOMZJ192lOdREll_8srT6Ij3hFEoByk0uYlXldUt5SUQSH9I9uRzn5Gtl06_7Y6wnHlJITLsmtB6n0nz-pent9Po_F0pA8w3e_KR-FmXfKfjpT2V-1IVi0 Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 8424741e1d154c6c9b08b19fb7c61d33 Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-VolumesActionsTest-1757398995 Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:41:44.673865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8424741e1d154c6c9b08b19fb7c61d33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8424741e1d154c6c9b08b19fb7c61d33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8424741e1d154c6c9b08b19fb7c61d33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8424741e1d154c6c9b08b19fb7c61d33", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-VolumesActionsTest-1757398995 Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 8424741e1d154c6c9b08b19fb7c61d33 Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-VolumesActionsTest-1757398995 Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-VolumesActionsTest-1757398995-project Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: e4b36e6959444273872c300742d6ddb8 Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-VolumesActionsTest-1757398995-project Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance bd320ce6-9330-4f84-8d6e-bd6b776fe22a could not be found. Aug 24 16:41:44.675267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'bd320ce6-9330-4f84-8d6e-bd6b776fe22a'} Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd320ce6-9330-4f84-8d6e-bd6b776fe22a could not be found. Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:41:44.676103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd320ce6-9330-4f84-8d6e-bd6b776fe22a could not be found. Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd320ce6-9330-4f84-8d6e-bd6b776fe22a could not be found. Aug 24 16:41:44.677262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:44.678678 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] Returning 404 to user: Instance bd320ce6-9330-4f84-8d6e-bd6b776fe22a could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:41:44.678678 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ccf4225a-bbf4-4497-b83e-c5473e7cbf2e tempest-VolumesActionsTest-1757398995 tempest-VolumesActionsTest-1757398995-project] 10.222.0.52 "GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a" status: 404 len: 111 microversion: 2.1 time: 0.030525 Aug 24 16:41:44.678678 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 171/344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:44 2022] GET /compute/v2.1/servers/bd320ce6-9330-4f84-8d6e-bd6b776fe22a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:41:44.989635 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c4332271-7267-4e10-a958-15d3e21a3d6d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:44.990249 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c4332271-7267-4e10-a958-15d3e21a3d6d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:45.004122 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4332271-7267-4e10-a958-15d3e21a3d6d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:45.004937 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4332271-7267-4e10-a958-15d3e21a3d6d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:45.007483 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4332271-7267-4e10-a958-15d3e21a3d6d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:45.008249 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4332271-7267-4e10-a958-15d3e21a3d6d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:45.008717 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4332271-7267-4e10-a958-15d3e21a3d6d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:45.009150 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4332271-7267-4e10-a958-15d3e21a3d6d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:45.170152 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c4332271-7267-4e10-a958-15d3e21a3d6d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:45.179248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c4332271-7267-4e10-a958-15d3e21a3d6d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1500 microversion: 2.1 time: 0.200298 Aug 24 16:41:45.184405 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 174/345] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:44 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1500 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:45.201194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "383a3b02-53f5-4148-99b5-a98e5314678b"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:45.203696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:45.210983 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:45.211526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:45.211997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:45.212763 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:45.213214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:45.213645 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:45.249616 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] HTTP exception thrown: Cannot 'attach_volume' instance 1ad10931-9764-4362-a3b6-c5cd27974783 while it is in vm_state rescued Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Request method failure captured: Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: POST /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783/os-volume_attachments HTTP/1.1 Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 74 Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlRBhQR1lbs4RdUK-GiSPx-LtPDp2QiIndw-478r2tK5_Xz7olHCVUXWZVJ9gIW6gNDIzpDQZy_qXn2yPdlWeDbyTIMUIxN33m1zYrBlzuNeO2TFzdPUg9oQdxR4xHHbb6xtGJVMQSJxFDwQl1Z_U_5Iw3ml3O21qf7Ig12FpMTmpP0 Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 364a00263e804efe83ae759d9c4c01fb Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:41:45.253920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_364a00263e804efe83ae759d9c4c01fb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 364a00263e804efe83ae759d9c4c01fb Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-ServerRescueNegativeTestJSON-606785984-project Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: fded55a41aae41c6af61382a7c35372e Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606785984-project Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {"volumeAttachment": {"volumeId": "383a3b02-53f5-4148-99b5-a98e5314678b"}} Aug 24 16:41:45.255527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Cannot 'attach_volume' instance 1ad10931-9764-4362-a3b6-c5cd27974783 while it is in vm_state rescued Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'server_id': '1ad10931-9764-4362-a3b6-c5cd27974783', 'body': {'volumeAttachment': {'volumeId': '383a3b02-53f5-4148-99b5-a98e5314678b'}}} Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1ad10931-9764-4362-a3b6-c5cd27974783 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:41:45.256445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1ad10931-9764-4362-a3b6-c5cd27974783 while it is in vm_state rescued Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:41:45.257777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:41:45.259089 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:41:45.259089 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:41:45.259089 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1ad10931-9764-4362-a3b6-c5cd27974783 while it is in vm_state rescued Aug 24 16:41:45.259089 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:41:45.260352 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Returning 409 to user: Cannot 'attach_volume' instance 1ad10931-9764-4362-a3b6-c5cd27974783 while it is in vm_state rescued {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:41:45.261369 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-06ccbcaf-c820-4e0e-bb6b-04189f8526fb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064296 Aug 24 16:41:45.262091 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 172/346] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:41:45 2022] POST /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 16:41:45.271385 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-18704853-fcfe-4402-a1e2-04e1a501683b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:45.272169 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-18704853-fcfe-4402-a1e2-04e1a501683b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:45.279561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18704853-fcfe-4402-a1e2-04e1a501683b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:45.280510 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18704853-fcfe-4402-a1e2-04e1a501683b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:45.281125 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18704853-fcfe-4402-a1e2-04e1a501683b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:45.281990 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18704853-fcfe-4402-a1e2-04e1a501683b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:45.283371 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18704853-fcfe-4402-a1e2-04e1a501683b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:45.284201 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-18704853-fcfe-4402-a1e2-04e1a501683b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:45.434074 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-18704853-fcfe-4402-a1e2-04e1a501683b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783/action" status: 202 len: 0 microversion: 2.1 time: 0.166499 Aug 24 16:41:45.436243 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 175/347] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:41:45 2022] POST /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:41:45.447738 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-21787547-7902-474a-9f5e-637a98b2a7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:45.452243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-21787547-7902-474a-9f5e-637a98b2a7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:45.460961 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-21787547-7902-474a-9f5e-637a98b2a7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:45.461446 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-21787547-7902-474a-9f5e-637a98b2a7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:45.461873 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-21787547-7902-474a-9f5e-637a98b2a7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:45.462568 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-21787547-7902-474a-9f5e-637a98b2a7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:45.463015 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-21787547-7902-474a-9f5e-637a98b2a7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:45.463427 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-21787547-7902-474a-9f5e-637a98b2a7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:45.493316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:45.494183 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:45.521232 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:45.521949 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:45.522480 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:45.523293 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:45.532718 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:45.533755 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:45.917190 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-21787547-7902-474a-9f5e-637a98b2a7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:45.939293 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-21787547-7902-474a-9f5e-637a98b2a7db tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1508 microversion: 2.1 time: 0.497855 Aug 24 16:41:45.943367 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 173/348] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:45 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:46.009274 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-685e800c-bd53-4bbc-bd0c-1c75e1792387 req-29a362c0-2e06-4bfc-a912-b1c47fd04325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f46124-a6dc-4300-88a6-3143240719da", "name": "network-vif-plugged", "status": "completed", "tag": "f4013556-5bff-4eef-bfeb-7c2f27b64c4a"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:46.020403 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-685e800c-bd53-4bbc-bd0c-1c75e1792387 req-29a362c0-2e06-4bfc-a912-b1c47fd04325 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:46.021244 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-685e800c-bd53-4bbc-bd0c-1c75e1792387 req-29a362c0-2e06-4bfc-a912-b1c47fd04325 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:46.021909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-685e800c-bd53-4bbc-bd0c-1c75e1792387 req-29a362c0-2e06-4bfc-a912-b1c47fd04325 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:46.040234 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-685e800c-bd53-4bbc-bd0c-1c75e1792387 req-29a362c0-2e06-4bfc-a912-b1c47fd04325 service nova] Creating event network-vif-plugged:f4013556-5bff-4eef-bfeb-7c2f27b64c4a for instance 66f46124-a6dc-4300-88a6-3143240719da on hv-cinder-77957 Aug 24 16:41:46.046608 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-685e800c-bd53-4bbc-bd0c-1c75e1792387 req-29a362c0-2e06-4bfc-a912-b1c47fd04325 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040751 Aug 24 16:41:46.047786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 174/349] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:41:46.060381 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:46.080683 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:46.082601 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:46.083847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a5ab1ea4-ee02-447a-9efc-97e9ac3253a0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1737 microversion: 2.20 time: 0.604606 Aug 24 16:41:46.087562 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 176/350] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:45 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1737 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:41:46.963707 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a7a8531b-675f-4fd9-84fc-4d2e275c9a8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:46.964498 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a7a8531b-675f-4fd9-84fc-4d2e275c9a8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:46.971373 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a7a8531b-675f-4fd9-84fc-4d2e275c9a8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:46.972158 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a7a8531b-675f-4fd9-84fc-4d2e275c9a8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:46.972795 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a7a8531b-675f-4fd9-84fc-4d2e275c9a8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:46.973708 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a7a8531b-675f-4fd9-84fc-4d2e275c9a8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:46.974409 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a7a8531b-675f-4fd9-84fc-4d2e275c9a8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:46.974921 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a7a8531b-675f-4fd9-84fc-4d2e275c9a8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:47.111791 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:47.113316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:47.122315 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:47.123124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:47.123744 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:47.124655 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:47.125269 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:47.126745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:47.178366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a7a8531b-675f-4fd9-84fc-4d2e275c9a8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:47.198320 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a7a8531b-675f-4fd9-84fc-4d2e275c9a8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1508 microversion: 2.1 time: 0.239323 Aug 24 16:41:47.199638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 175/351] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:46 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:47.403071 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:47.415100 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:47.416901 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:47.418263 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c6e9d500-8043-4ae7-ba24-a4a9a7c0f1a4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1737 microversion: 2.20 time: 0.311661 Aug 24 16:41:47.419286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 177/352] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:47 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1737 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:41:48.224949 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1bc8f038-94fe-460a-a119-927afc6cdc6c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:48.226355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1bc8f038-94fe-460a-a119-927afc6cdc6c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:48.236566 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1bc8f038-94fe-460a-a119-927afc6cdc6c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:48.237494 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1bc8f038-94fe-460a-a119-927afc6cdc6c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:48.238172 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1bc8f038-94fe-460a-a119-927afc6cdc6c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:48.239125 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1bc8f038-94fe-460a-a119-927afc6cdc6c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:48.239820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1bc8f038-94fe-460a-a119-927afc6cdc6c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:48.240510 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1bc8f038-94fe-460a-a119-927afc6cdc6c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:48.415020 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1bc8f038-94fe-460a-a119-927afc6cdc6c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:48.424423 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1bc8f038-94fe-460a-a119-927afc6cdc6c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1508 microversion: 2.1 time: 0.209321 Aug 24 16:41:48.432408 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 176/353] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:48 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:48.501554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:48.503059 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:48.528035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:48.529708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:48.530399 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:48.531653 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:48.535978 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:48.536825 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:48.825460 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:48.837161 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:48.841498 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:48.843883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1f9be8c8-60a6-468c-ac43-c12d4fed1b1f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1737 microversion: 2.20 time: 0.401635 Aug 24 16:41:48.844460 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 178/354] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:48 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:49.448341 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-62ce7dbe-4f4c-43a3-948a-dc8e71b60dc8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:49.448909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-62ce7dbe-4f4c-43a3-948a-dc8e71b60dc8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:49.457515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=72 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:49.459893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62ce7dbe-4f4c-43a3-948a-dc8e71b60dc8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:49.460420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62ce7dbe-4f4c-43a3-948a-dc8e71b60dc8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:49.463205 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62ce7dbe-4f4c-43a3-948a-dc8e71b60dc8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:49.464181 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62ce7dbe-4f4c-43a3-948a-dc8e71b60dc8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:49.467760 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62ce7dbe-4f4c-43a3-948a-dc8e71b60dc8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:49.468475 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62ce7dbe-4f4c-43a3-948a-dc8e71b60dc8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:49.645420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-62ce7dbe-4f4c-43a3-948a-dc8e71b60dc8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:49.654948 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-62ce7dbe-4f4c-43a3-948a-dc8e71b60dc8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1514 microversion: 2.1 time: 0.210772 Aug 24 16:41:49.674918 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 177/355] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:49 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:49.869746 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:49.870363 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:49.882882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:49.886291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:49.886739 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:49.887753 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:49.888270 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:49.888683 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:50.144640 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:50.168804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:50.170613 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:50.172117 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2d7d3261-b347-4f37-b1d3-df2e960f5849 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1737 microversion: 2.20 time: 0.307023 Aug 24 16:41:50.173436 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 179/356] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:49 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:51.201980 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:51.202709 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:51.211545 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:51.212159 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:51.212659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:51.213422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:51.213944 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:51.214812 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:51.362473 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:51.371173 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:51.373068 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:51.374292 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b49c5748-2c3c-477f-be05-d7b1caa41a6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1737 microversion: 2.20 time: 0.177471 Aug 24 16:41:51.374932 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 178/357] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:51 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:52.397806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:52.398409 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:52.405004 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:52.405704 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:52.406136 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:52.407129 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:52.407599 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:52.408048 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:52.562250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:52.575977 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:52.577478 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:52.578623 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f8f718b4-19c3-4f69-b1ad-458ea5b5bd23 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1737 microversion: 2.20 time: 0.184816 Aug 24 16:41:52.579851 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 180/358] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:52 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:53.604251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:53.604953 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:53.612226 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:53.612920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:53.613841 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:53.614368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:53.614901 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:53.615381 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:53.619709 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=100 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:53.756653 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:53.770266 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:53.771832 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:53.773269 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8f288513-148a-4e09-9f43-f01435d83903 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1737 microversion: 2.20 time: 0.173076 Aug 24 16:41:53.774304 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 179/359] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:53 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:54.800007 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:54.801004 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:54.809167 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:54.809650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:54.810077 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:54.810775 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:54.811225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:54.811639 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:54.966049 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:54.975584 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:54.977218 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:54.978129 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7762ca40-ec6b-460c-a841-4585f833b29f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1737 microversion: 2.20 time: 0.183396 Aug 24 16:41:54.978685 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 181/360] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:54 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:56.006419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:56.007011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:56.014214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:56.014695 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:56.015127 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:56.015810 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:56.016816 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:56.017544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:56.152922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:56.161357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:56.162891 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:56.164072 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-5f252123-2ac1-438a-bafb-0ebc51df0b31 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1737 microversion: 2.20 time: 0.163815 Aug 24 16:41:56.164625 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 180/361] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:55 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:41:56.442742 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ef4b2fa6-5a70-49d8-8994-8b6fd2c648dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'create', calling method: .version_select at 0x7f063b5a5ca0>, body: {"keypair": {"name": "tempest-keypair-1548074002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBxUdE6JMVW7juYNxfqkszqZ4TeT7xqqdvm6cS8mj0LRGvTzZhH0b7Lk/5ffasEUNcyI3r4BFbPl7wfHzR4z2ywaYy5/lxmLjPsGGo7D8rIPsYI3HZuS0qYDrUaMLQS7w=="}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:56.458357 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:56.468515 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-ef4b2fa6-5a70-49d8-8994-8b6fd2c648dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Getting quotas for project 364a00263e804efe83ae759d9c4c01fb. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:41:56.474327 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-ef4b2fa6-5a70-49d8-8994-8b6fd2c648dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Getting quotas for user fded55a41aae41c6af61382a7c35372e and project 364a00263e804efe83ae759d9c4c01fb. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:41:56.533090 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ef4b2fa6-5a70-49d8-8994-8b6fd2c648dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093354 Aug 24 16:41:56.533745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 182/362] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 16:41:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:41:57.190821 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:57.192580 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:57.203275 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:57.204570 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:57.205478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:57.206517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:57.207452 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:57.210370 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:57.425449 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:57.451968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:57.461815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:57.463419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2ac037c2-e9d0-476e-91c1-7bcb8fafd485 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1719 microversion: 2.20 time: 0.279887 Aug 24 16:41:57.486833 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 181/363] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:57 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1719 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:41:58.266670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-894123957", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68fa56df-1aa3-4489-9841-9bef4d938e1c"}], "security_groups": [{"name": "tempest-securitygroup--638518303"}], "key_name": "tempest-keypair-1548074002", "user_data": "}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:41:58.420525 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] validate_networks() for [('68fa56df-1aa3-4489-9841-9bef4d938e1c', None, None, None, None, None)] {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:41:58.492509 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:58.493921 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:58.502652 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:58.503441 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:58.504077 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:58.505055 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:58.505802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:58.506298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:58.793889 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:58.807477 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:58.810017 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:58.811541 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-22a978d2-752e-47e5-9377-1ddbc9069b58 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1719 microversion: 2.20 time: 0.323400 Aug 24 16:41:58.812460 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 182/364] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:58 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1719 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:41:59.068088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:41:59.068616 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:41:59.069202 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:41:59.069706 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:41:59.070339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:41:59.079503 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:59.080131 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:59.080782 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:59.081714 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:59.082259 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:59.082889 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:59.102969 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Getting quotas for project 364a00263e804efe83ae759d9c4c01fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:41:59.107499 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Getting quotas for user fded55a41aae41c6af61382a7c35372e and project 364a00263e804efe83ae759d9c4c01fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:41:59.126000 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:41:59.142079 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:41:59.211888 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-4e7f08a8-8da5-4552-b6b6-ecc2203a30cd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.950143 Aug 24 16:41:59.213123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 183/365] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:41:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:41:59.224454 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1a3ebea2-4099-43d4-8580-2c0452c8f2fd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:59.225116 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1a3ebea2-4099-43d4-8580-2c0452c8f2fd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:59.308700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1a3ebea2-4099-43d4-8580-2c0452c8f2fd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:41:59.318753 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1a3ebea2-4099-43d4-8580-2c0452c8f2fd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1245 microversion: 2.1 time: 0.098413 Aug 24 16:41:59.320413 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 183/366] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:41:59 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:41:59.834856 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:41:59.836206 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:41:59.843122 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:59.843905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:59.844738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:41:59.845767 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:41:59.846228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:41:59.846847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:00.017633 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:00.024712 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-6dc52fe3-73d0-4b35-b460-cae1939a6986 req-29983746-7221-41c4-bc89-54ddb73386ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f46124-a6dc-4300-88a6-3143240719da", "name": "network-vif-unplugged", "status": "completed", "tag": "f4013556-5bff-4eef-bfeb-7c2f27b64c4a"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:00.041395 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:00.043148 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:00.044350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ac9b3d4f-100f-40d3-b42c-8a8679b5234b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1662 microversion: 2.20 time: 0.213467 Aug 24 16:42:00.044912 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 184/367] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:41:59 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1662 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:00.048182 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6dc52fe3-73d0-4b35-b460-cae1939a6986 req-29983746-7221-41c4-bc89-54ddb73386ba service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:00.048877 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6dc52fe3-73d0-4b35-b460-cae1939a6986 req-29983746-7221-41c4-bc89-54ddb73386ba service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:00.049490 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6dc52fe3-73d0-4b35-b460-cae1939a6986 req-29983746-7221-41c4-bc89-54ddb73386ba service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:00.061452 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.compute.server_external_events [req-6dc52fe3-73d0-4b35-b460-cae1939a6986 req-29983746-7221-41c4-bc89-54ddb73386ba service nova] Unable to find a host for instance 66f46124-a6dc-4300-88a6-3143240719da. Dropping event network-vif-unplugged {{(pid=127165) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 16:42:00.062611 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-6dc52fe3-73d0-4b35-b460-cae1939a6986 req-29983746-7221-41c4-bc89-54ddb73386ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049812 Aug 24 16:42:00.063565 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 184/368] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 16:42:00.068763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-44069956-307d-46c5-a892-f32300953bc0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "468bf54e-d173-43cb-a390-646cf393a169"}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:00.072821 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-44069956-307d-46c5-a892-f32300953bc0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:00.082038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44069956-307d-46c5-a892-f32300953bc0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:00.082847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44069956-307d-46c5-a892-f32300953bc0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:00.083498 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44069956-307d-46c5-a892-f32300953bc0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:00.084387 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44069956-307d-46c5-a892-f32300953bc0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:00.085047 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44069956-307d-46c5-a892-f32300953bc0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:00.085674 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44069956-307d-46c5-a892-f32300953bc0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:00.109463 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:00.343375 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-947e3797-a412-49d5-b3dc-deb09c4121c0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:00.348623 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-947e3797-a412-49d5-b3dc-deb09c4121c0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:00.357705 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-947e3797-a412-49d5-b3dc-deb09c4121c0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:00.360719 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-947e3797-a412-49d5-b3dc-deb09c4121c0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:00.362215 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-947e3797-a412-49d5-b3dc-deb09c4121c0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:00.363265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-947e3797-a412-49d5-b3dc-deb09c4121c0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:00.363925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-947e3797-a412-49d5-b3dc-deb09c4121c0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:00.364696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-947e3797-a412-49d5-b3dc-deb09c4121c0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:00.471286 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-947e3797-a412-49d5-b3dc-deb09c4121c0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:00.486412 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-947e3797-a412-49d5-b3dc-deb09c4121c0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1297 microversion: 2.1 time: 0.146913 Aug 24 16:42:00.488238 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 185/369] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:00 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1297 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:00.557870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-44069956-307d-46c5-a892-f32300953bc0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "POST /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.493186 Aug 24 16:42:00.558492 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 185/370] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Aug 24 16:42:00 2022] POST /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-volume_attachments => generated 188 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 16:42:00.746520 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-669a4877-b2a3-40b8-ae35-d10fbcffde2b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:00.747273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-669a4877-b2a3-40b8-ae35-d10fbcffde2b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:00.756298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669a4877-b2a3-40b8-ae35-d10fbcffde2b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:00.756929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669a4877-b2a3-40b8-ae35-d10fbcffde2b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:00.757512 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669a4877-b2a3-40b8-ae35-d10fbcffde2b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:00.758462 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669a4877-b2a3-40b8-ae35-d10fbcffde2b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:00.759102 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669a4877-b2a3-40b8-ae35-d10fbcffde2b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:00.759552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669a4877-b2a3-40b8-ae35-d10fbcffde2b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:00.834991 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-669a4877-b2a3-40b8-ae35-d10fbcffde2b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127165) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 16:42:00.973984 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-669a4877-b2a3-40b8-ae35-d10fbcffde2b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "POST /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/action" status: 202 len: 0 microversion: 2.20 time: 0.238203 Aug 24 16:42:00.974706 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 186/371] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 24 16:42:00 2022] POST /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:42:00.982812 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:00.983502 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:00.995479 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:00.998594 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:01.001376 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:01.002151 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:01.002627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:01.003812 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:01.515314 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-054015e2-c3bc-4d72-956e-6ce1c5afc357 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:01.517987 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-054015e2-c3bc-4d72-956e-6ce1c5afc357 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:01.530052 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-054015e2-c3bc-4d72-956e-6ce1c5afc357 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:01.530548 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-054015e2-c3bc-4d72-956e-6ce1c5afc357 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:01.531169 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-054015e2-c3bc-4d72-956e-6ce1c5afc357 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:01.532139 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-054015e2-c3bc-4d72-956e-6ce1c5afc357 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:01.533680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-054015e2-c3bc-4d72-956e-6ce1c5afc357 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:01.536517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-054015e2-c3bc-4d72-956e-6ce1c5afc357 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:01.631363 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-054015e2-c3bc-4d72-956e-6ce1c5afc357 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:01.645516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-054015e2-c3bc-4d72-956e-6ce1c5afc357 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1303 microversion: 2.1 time: 0.130539 Aug 24 16:42:01.653113 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 187/372] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:01 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:01.693525 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:01.705530 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:01.707174 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:01.711422 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c2168456-bd15-4653-bdcd-bf1fa19ec8a8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1748 microversion: 2.20 time: 0.732494 Aug 24 16:42:01.716669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 186/373] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:00 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1748 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:42:02.670377 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7c502972-e4e2-4854-89d3-3008ed697612 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:02.671177 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7c502972-e4e2-4854-89d3-3008ed697612 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:02.684362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c502972-e4e2-4854-89d3-3008ed697612 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:02.692734 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c502972-e4e2-4854-89d3-3008ed697612 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:02.694043 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c502972-e4e2-4854-89d3-3008ed697612 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:02.698867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c502972-e4e2-4854-89d3-3008ed697612 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:02.699550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c502972-e4e2-4854-89d3-3008ed697612 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:02.700045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c502972-e4e2-4854-89d3-3008ed697612 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:02.737638 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:02.739618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:02.754399 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:02.755300 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:02.756042 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:02.757818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:02.758502 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:02.759229 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:03.321641 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7c502972-e4e2-4854-89d3-3008ed697612 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:03.363482 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7c502972-e4e2-4854-89d3-3008ed697612 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1370 microversion: 2.1 time: 0.697088 Aug 24 16:42:03.371367 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 188/374] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:02 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1370 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:03.540728 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:03.551215 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:03.569686 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:03.572390 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8c3f4133-8a19-4c51-bdb4-2518080bfab1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1748 microversion: 2.20 time: 0.839779 Aug 24 16:42:03.582269 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 187/375] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:02 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1748 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:03.967681 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-b8cb29d4-d405-4b8e-b103-81f1c44cd5aa req-608c57ef-995f-4e1d-b22e-5803fec16ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0aa7b07-8c79-4568-af26-cc2273f85a11", "tag": "059a432e-b0cb-433f-af23-9677d8b9ba22"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:03.983854 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-b8cb29d4-d405-4b8e-b103-81f1c44cd5aa req-608c57ef-995f-4e1d-b22e-5803fec16ddd service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:03.985207 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-b8cb29d4-d405-4b8e-b103-81f1c44cd5aa req-608c57ef-995f-4e1d-b22e-5803fec16ddd service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:03.986268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-b8cb29d4-d405-4b8e-b103-81f1c44cd5aa req-608c57ef-995f-4e1d-b22e-5803fec16ddd service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:04.024766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-b8cb29d4-d405-4b8e-b103-81f1c44cd5aa req-608c57ef-995f-4e1d-b22e-5803fec16ddd service nova] Creating event network-changed:059a432e-b0cb-433f-af23-9677d8b9ba22 for instance f0aa7b07-8c79-4568-af26-cc2273f85a11 on hv-cinder-77957 Aug 24 16:42:04.039421 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-b8cb29d4-d405-4b8e-b103-81f1c44cd5aa req-608c57ef-995f-4e1d-b22e-5803fec16ddd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077164 Aug 24 16:42:04.040735 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 189/376] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:04.409132 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-cb7e2ed6-75a7-44f9-8535-ab22d13e6c7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:04.410017 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-cb7e2ed6-75a7-44f9-8535-ab22d13e6c7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:04.417780 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cb7e2ed6-75a7-44f9-8535-ab22d13e6c7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:04.423186 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cb7e2ed6-75a7-44f9-8535-ab22d13e6c7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:04.423736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cb7e2ed6-75a7-44f9-8535-ab22d13e6c7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:04.425125 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cb7e2ed6-75a7-44f9-8535-ab22d13e6c7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:04.427806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cb7e2ed6-75a7-44f9-8535-ab22d13e6c7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:04.428369 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cb7e2ed6-75a7-44f9-8535-ab22d13e6c7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:04.616682 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:04.618029 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:04.647347 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:04.648979 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:04.650565 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:04.652613 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:04.655013 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:04.655582 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:04.751677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-cb7e2ed6-75a7-44f9-8535-ab22d13e6c7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:04.765254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-cb7e2ed6-75a7-44f9-8535-ab22d13e6c7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1370 microversion: 2.1 time: 0.360116 Aug 24 16:42:04.766523 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 188/377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:04 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:04.951905 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:04.962488 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:04.964380 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:04.965855 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-64413112-0cdd-4268-a228-5ff66a0ad690 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.357740 Aug 24 16:42:04.967068 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 190/378] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:04 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:42:05.787639 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0144ed95-069f-4f7b-b3a6-da7888f67115 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:05.788939 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0144ed95-069f-4f7b-b3a6-da7888f67115 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:05.795242 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0144ed95-069f-4f7b-b3a6-da7888f67115 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:05.795731 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0144ed95-069f-4f7b-b3a6-da7888f67115 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:05.796195 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0144ed95-069f-4f7b-b3a6-da7888f67115 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:05.797705 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0144ed95-069f-4f7b-b3a6-da7888f67115 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:05.798330 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0144ed95-069f-4f7b-b3a6-da7888f67115 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:05.798916 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0144ed95-069f-4f7b-b3a6-da7888f67115 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:06.003697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:06.004530 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:06.019937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:06.020577 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:06.021044 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:06.039333 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:06.039830 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:06.040394 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:06.122085 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0144ed95-069f-4f7b-b3a6-da7888f67115 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:06.130714 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0144ed95-069f-4f7b-b3a6-da7888f67115 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1370 microversion: 2.1 time: 0.346797 Aug 24 16:42:06.133925 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 189/379] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:05 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:06.403743 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:06.419536 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:06.426260 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:06.430642 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7ef2c98a-ee7d-4d8b-8c5d-b8b3f3190a3d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.442677 Aug 24 16:42:06.443977 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 191/380] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:05 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:07.155621 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0e5252af-9404-4495-b0d0-9bd1585f781c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:07.157250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0e5252af-9404-4495-b0d0-9bd1585f781c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:07.170645 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e5252af-9404-4495-b0d0-9bd1585f781c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:07.171798 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e5252af-9404-4495-b0d0-9bd1585f781c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:07.173198 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e5252af-9404-4495-b0d0-9bd1585f781c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:07.174267 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e5252af-9404-4495-b0d0-9bd1585f781c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:07.174894 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e5252af-9404-4495-b0d0-9bd1585f781c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:07.176544 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0e5252af-9404-4495-b0d0-9bd1585f781c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:07.460631 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:07.461247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:07.474354 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:07.475129 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:07.475735 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:07.476713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:07.478434 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:07.480838 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:07.595046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0e5252af-9404-4495-b0d0-9bd1585f781c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:07.613132 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0e5252af-9404-4495-b0d0-9bd1585f781c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1370 microversion: 2.1 time: 0.466022 Aug 24 16:42:07.614579 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 190/381] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:07 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1370 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:07.892829 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:07.905993 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:07.907665 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:07.908957 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b6abb125-535f-44ad-89f2-69b7f304dfcb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.454014 Aug 24 16:42:07.932316 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 192/382] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:07 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:08.634586 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-02f5c46d-21a4-4667-bd25-ad85b73c30ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:08.635738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-02f5c46d-21a4-4667-bd25-ad85b73c30ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:08.646623 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02f5c46d-21a4-4667-bd25-ad85b73c30ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:08.647354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02f5c46d-21a4-4667-bd25-ad85b73c30ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:08.649779 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02f5c46d-21a4-4667-bd25-ad85b73c30ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:08.651131 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02f5c46d-21a4-4667-bd25-ad85b73c30ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:08.653386 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02f5c46d-21a4-4667-bd25-ad85b73c30ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:08.655706 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02f5c46d-21a4-4667-bd25-ad85b73c30ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:08.937778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:08.939120 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:08.949850 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:08.964403 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:08.965239 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:08.966234 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:08.966911 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:08.967556 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:09.091028 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:09.111000 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-02f5c46d-21a4-4667-bd25-ad85b73c30ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:09.124706 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=10 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:09.129857 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-02f5c46d-21a4-4667-bd25-ad85b73c30ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1370 microversion: 2.1 time: 0.498318 Aug 24 16:42:09.130911 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 191/383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:08 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1370 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:09.319513 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:09.482125 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:09.496331 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:09.502025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:09.508848 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7759e8d8-a1ca-4337-adfc-0d942213f493 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.576297 Aug 24 16:42:09.512316 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 193/384] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:08 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:10.160598 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-562a43ae-5b0b-4e82-8fcb-3ca04c940306 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:10.161852 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-562a43ae-5b0b-4e82-8fcb-3ca04c940306 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:10.171195 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562a43ae-5b0b-4e82-8fcb-3ca04c940306 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:10.173009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562a43ae-5b0b-4e82-8fcb-3ca04c940306 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:10.174178 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562a43ae-5b0b-4e82-8fcb-3ca04c940306 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:10.177500 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562a43ae-5b0b-4e82-8fcb-3ca04c940306 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:10.179412 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562a43ae-5b0b-4e82-8fcb-3ca04c940306 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:10.180677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-562a43ae-5b0b-4e82-8fcb-3ca04c940306 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:10.494099 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-562a43ae-5b0b-4e82-8fcb-3ca04c940306 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:10.516553 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-562a43ae-5b0b-4e82-8fcb-3ca04c940306 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1370 microversion: 2.1 time: 0.359140 Aug 24 16:42:10.517343 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 192/385] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:10 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:10.541575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:10.542802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:10.556304 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:10.560378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:10.561107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:10.562120 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:10.563306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:10.563895 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:10.975632 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:10.990306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:10.993984 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:10.997404 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-63d724e5-02a2-497a-b322-d9ec995f5710 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.459819 Aug 24 16:42:11.012243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 194/386] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:10 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:11.539196 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d1c1cdc9-c104-41ce-97b3-6ac27ef2e125 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:11.539925 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d1c1cdc9-c104-41ce-97b3-6ac27ef2e125 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:11.556339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d1c1cdc9-c104-41ce-97b3-6ac27ef2e125 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:11.556997 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d1c1cdc9-c104-41ce-97b3-6ac27ef2e125 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:11.557561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d1c1cdc9-c104-41ce-97b3-6ac27ef2e125 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:11.560816 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d1c1cdc9-c104-41ce-97b3-6ac27ef2e125 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:11.568481 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d1c1cdc9-c104-41ce-97b3-6ac27ef2e125 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:11.569105 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d1c1cdc9-c104-41ce-97b3-6ac27ef2e125 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:12.030060 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:12.031422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:12.054581 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:12.059552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:12.060573 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:12.063647 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:12.068695 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:12.069497 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:12.135316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d1c1cdc9-c104-41ce-97b3-6ac27ef2e125 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:12.146113 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d1c1cdc9-c104-41ce-97b3-6ac27ef2e125 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1370 microversion: 2.1 time: 0.610962 Aug 24 16:42:12.168878 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 193/387] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:11 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1370 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:13.101167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:13.126041 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:13.140924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:13.142439 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-84680562-7b7a-4c38-a484-681775be3585 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 1.117351 Aug 24 16:42:13.143340 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 195/388] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:12 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:13.184360 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-23d22803-b1e8-4881-8414-42a4fd739920 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:13.185189 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-23d22803-b1e8-4881-8414-42a4fd739920 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:13.200137 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23d22803-b1e8-4881-8414-42a4fd739920 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:13.208349 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23d22803-b1e8-4881-8414-42a4fd739920 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:13.215606 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23d22803-b1e8-4881-8414-42a4fd739920 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:13.216803 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23d22803-b1e8-4881-8414-42a4fd739920 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:13.220229 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23d22803-b1e8-4881-8414-42a4fd739920 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:13.220986 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23d22803-b1e8-4881-8414-42a4fd739920 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:14.022871 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-23d22803-b1e8-4881-8414-42a4fd739920 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:14.036604 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-23d22803-b1e8-4881-8414-42a4fd739920 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1370 microversion: 2.1 time: 0.851016 Aug 24 16:42:14.037773 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 194/389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:13 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1370 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:14.170233 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:14.171472 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:14.178759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:14.192458 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:14.193192 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:14.194110 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:14.194731 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:14.195335 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:14.713957 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:14.732256 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:14.740734 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:14.742585 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2e37aed6-702a-4e62-8c2e-aa9ba31dcb08 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.576116 Aug 24 16:42:14.744442 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 196/390] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:14 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:42:15.072714 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-49363272-0e13-488d-aade-c008f3f720d7 req-fd123e8f-510e-48f8-9512-0ab9193d537d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0aa7b07-8c79-4568-af26-cc2273f85a11", "name": "network-vif-plugged", "status": "completed", "tag": "059a432e-b0cb-433f-af23-9677d8b9ba22"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:15.076117 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0031aef5-fa63-40a9-a153-2068818090d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:15.077482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0031aef5-fa63-40a9-a153-2068818090d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:15.115574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0031aef5-fa63-40a9-a153-2068818090d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:15.117546 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0031aef5-fa63-40a9-a153-2068818090d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:15.119078 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0031aef5-fa63-40a9-a153-2068818090d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:15.122555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0031aef5-fa63-40a9-a153-2068818090d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:15.123545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0031aef5-fa63-40a9-a153-2068818090d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:15.124831 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-49363272-0e13-488d-aade-c008f3f720d7 req-fd123e8f-510e-48f8-9512-0ab9193d537d service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:15.125627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0031aef5-fa63-40a9-a153-2068818090d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:15.126517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-49363272-0e13-488d-aade-c008f3f720d7 req-fd123e8f-510e-48f8-9512-0ab9193d537d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:15.128109 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-49363272-0e13-488d-aade-c008f3f720d7 req-fd123e8f-510e-48f8-9512-0ab9193d537d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:15.141321 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:15.167061 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-49363272-0e13-488d-aade-c008f3f720d7 req-fd123e8f-510e-48f8-9512-0ab9193d537d service nova] Creating event network-vif-plugged:059a432e-b0cb-433f-af23-9677d8b9ba22 for instance f0aa7b07-8c79-4568-af26-cc2273f85a11 on hv-cinder-77957 Aug 24 16:42:15.182405 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-49363272-0e13-488d-aade-c008f3f720d7 req-fd123e8f-510e-48f8-9512-0ab9193d537d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120105 Aug 24 16:42:15.186794 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 197/391] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:42:15.603196 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0031aef5-fa63-40a9-a153-2068818090d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:15.624392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0031aef5-fa63-40a9-a153-2068818090d1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1370 microversion: 2.1 time: 0.567814 Aug 24 16:42:15.626625 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 195/392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:15 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1370 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:15.773129 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:15.774126 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:15.794660 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:15.795399 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:15.796074 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:15.797014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:15.798860 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:15.800567 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:16.437032 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:16.460764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:16.465351 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:16.475505 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-76a937a2-033c-49d8-a978-3b5e2948824b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.708027 Aug 24 16:42:16.476146 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 198/393] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:15 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:16.646745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d6214982-11c6-4b16-8ba4-fec1f78252ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:16.648361 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d6214982-11c6-4b16-8ba4-fec1f78252ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:16.671398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d6214982-11c6-4b16-8ba4-fec1f78252ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:16.672236 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d6214982-11c6-4b16-8ba4-fec1f78252ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:16.674598 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d6214982-11c6-4b16-8ba4-fec1f78252ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:16.676672 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d6214982-11c6-4b16-8ba4-fec1f78252ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:16.683078 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d6214982-11c6-4b16-8ba4-fec1f78252ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:16.696382 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d6214982-11c6-4b16-8ba4-fec1f78252ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:17.107927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d6214982-11c6-4b16-8ba4-fec1f78252ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:17.121072 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d6214982-11c6-4b16-8ba4-fec1f78252ff tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1370 microversion: 2.1 time: 0.478257 Aug 24 16:42:17.125536 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 196/394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:16 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1370 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:17.519035 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:17.519599 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:17.561277 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:17.565967 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:17.567893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:17.574854 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:17.575680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:17.576338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:18.060530 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:18.090379 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:18.098077 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:18.106822 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-5794bb40-4a18-4227-83b4-cd0c97050163 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.593039 Aug 24 16:42:18.114859 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 199/395] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:17 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:18.151546 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-23b0f5d4-000b-43a3-895e-d8fd8ea5aa57 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:18.152339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-23b0f5d4-000b-43a3-895e-d8fd8ea5aa57 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:18.189755 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23b0f5d4-000b-43a3-895e-d8fd8ea5aa57 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:18.190317 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23b0f5d4-000b-43a3-895e-d8fd8ea5aa57 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:18.190774 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23b0f5d4-000b-43a3-895e-d8fd8ea5aa57 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:18.191561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23b0f5d4-000b-43a3-895e-d8fd8ea5aa57 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:18.192168 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23b0f5d4-000b-43a3-895e-d8fd8ea5aa57 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:18.200347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23b0f5d4-000b-43a3-895e-d8fd8ea5aa57 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:19.139803 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:19.141889 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:19.189705 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:19.190775 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:19.191534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:19.193799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:19.196527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:19.197633 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:19.789161 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-23b0f5d4-000b-43a3-895e-d8fd8ea5aa57 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:19.802765 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-23b0f5d4-000b-43a3-895e-d8fd8ea5aa57 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1563 microversion: 2.1 time: 1.660942 Aug 24 16:42:19.808583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 197/396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:18 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1563 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:19.832316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-26056899-6922-4390-9837-6d6f85be3b76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:19.833108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-26056899-6922-4390-9837-6d6f85be3b76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:19.861714 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-26056899-6922-4390-9837-6d6f85be3b76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:19.872953 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-26056899-6922-4390-9837-6d6f85be3b76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:19.873868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-26056899-6922-4390-9837-6d6f85be3b76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:19.874965 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-26056899-6922-4390-9837-6d6f85be3b76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:19.885405 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-26056899-6922-4390-9837-6d6f85be3b76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:19.886230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-26056899-6922-4390-9837-6d6f85be3b76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:20.147915 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-26056899-6922-4390-9837-6d6f85be3b76 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.323297 Aug 24 16:42:20.149076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 198/397] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 16:42:19 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-interface => generated 284 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:20.801117 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:20.812316 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:20.821942 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:20.828298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9e59b309-9976-4f04-b2c1-67d84cad57c4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 1.696251 Aug 24 16:42:20.830181 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 200/398] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:19 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:21.855927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:21.856709 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:21.868171 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:21.878888 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:21.880264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:21.882304 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:21.884194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:21.884741 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:22.431797 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:22.434592 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:22.454877 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:22.461836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:22.467540 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9ccee09c-b677-4e02-b103-5e8dc68d81cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.616175 Aug 24 16:42:22.482932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 199/399] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:21 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:23.498719 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:23.500104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:23.516575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:23.526939 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:23.527666 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:23.528235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:23.533490 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:23.534263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:23.536327 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:24.135578 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:24.170152 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:24.195552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:24.202540 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-737d96f3-12f9-49cf-92a0-92b7e031e6bf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.704368 Aug 24 16:42:24.204150 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 201/400] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:23 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:25.229967 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:25.230543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:25.257237 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:25.258091 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:25.258758 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:25.270929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:25.274472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:25.276552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:25.857160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:25.869432 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:25.870931 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:25.892398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ef12467b-c517-45e5-8a20-57a974bbcf4d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.649274 Aug 24 16:42:25.893002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 200/401] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:25 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:25.999274 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-1b072ce6-6496-4e93-a8ea-3f825a063fd0 req-ce9bcd92-1bf6-46cd-b61e-fc298fb34a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0aa7b07-8c79-4568-af26-cc2273f85a11", "tag": "059a432e-b0cb-433f-af23-9677d8b9ba22"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:26.024371 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-1b072ce6-6496-4e93-a8ea-3f825a063fd0 req-ce9bcd92-1bf6-46cd-b61e-fc298fb34a40 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:26.024860 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-1b072ce6-6496-4e93-a8ea-3f825a063fd0 req-ce9bcd92-1bf6-46cd-b61e-fc298fb34a40 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:26.039661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-1b072ce6-6496-4e93-a8ea-3f825a063fd0 req-ce9bcd92-1bf6-46cd-b61e-fc298fb34a40 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:26.074230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-1b072ce6-6496-4e93-a8ea-3f825a063fd0 req-ce9bcd92-1bf6-46cd-b61e-fc298fb34a40 service nova] Creating event network-changed:059a432e-b0cb-433f-af23-9677d8b9ba22 for instance f0aa7b07-8c79-4568-af26-cc2273f85a11 on hv-cinder-77957 Aug 24 16:42:26.090474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-1b072ce6-6496-4e93-a8ea-3f825a063fd0 req-ce9bcd92-1bf6-46cd-b61e-fc298fb34a40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092568 Aug 24 16:42:26.091860 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 202/402] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:26.914806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:26.916188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:26.926349 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:26.928883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:26.930121 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:26.931136 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:26.933314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:26.946311 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:26.946880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:27.793839 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:27.805046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:27.806543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:27.818079 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2baf7804-e202-482f-a52c-d7f42e3f977f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.896974 Aug 24 16:42:27.819464 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 201/403] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:26 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:28.842600 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:28.843510 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:28.867339 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:28.868067 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:28.870536 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:28.871319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:28.871791 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:28.877023 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:29.353287 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:29.362968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:29.364518 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:29.378539 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-fca7ec57-8169-4605-abf7-4beb464c82d6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.539972 Aug 24 16:42:29.378982 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 203/404] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:28 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:29.925794 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-21b20bc4-cb67-4a78-b829-93acf7dad4e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Action: 'create', calling method: .version_select at 0x7f063b41b550>, body: {"keypair": {"name": "tempest-TestShelveInstance-501083313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAku4TvJ/z8qvucAUGrKGPVOHIsTpZLrvTkwpcoYzNuZFfZPRWND6UBIcM2omzUJW9P6gsZsUvCszPEenNIvG+YWXsGUM+VpSwc0InwZ+dkH1gI5sFir+S5sFWD+qgksrg=="}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:29.966091 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-21b20bc4-cb67-4a78-b829-93acf7dad4e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Getting quotas for project cd41122fd4e94aa786798d8f54214f0a. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:42:29.973495 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-21b20bc4-cb67-4a78-b829-93acf7dad4e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Getting quotas for user 9fb81fa5765c44a0afa8d9fb4786272c and project cd41122fd4e94aa786798d8f54214f0a. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:42:30.023814 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-21b20bc4-cb67-4a78-b829-93acf7dad4e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.636414 Aug 24 16:42:30.024729 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 202/405] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 16:42:29 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:30.402606 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:30.404023 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:30.419837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:30.420713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:30.422708 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:30.423626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:30.424333 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:30.425363 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:30.783243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:30.793616 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:30.801127 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:30.802355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-69ecdd65-c104-4c48-8f3a-3f1b9aea2b5e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.404077 Aug 24 16:42:30.816405 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 204/406] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:30 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:31.828839 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:31.830132 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:31.836790 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:31.838485 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:31.839130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:31.840128 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:31.840804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:31.841457 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:32.661790 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:32.672783 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:32.674666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:32.676825 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0f33fa41-62d8-44b8-914d-633dbe864dce tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.854048 Aug 24 16:42:32.693040 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 203/407] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:31 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:33.709234 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:33.711099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:33.726469 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:33.726978 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:33.727466 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:33.728215 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:33.728668 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:33.729090 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:34.043696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:34.060875 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:34.067645 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:34.071167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1901b28c-25f0-4798-99e3-3481c61381cf tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.372730 Aug 24 16:42:34.072035 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 205/408] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:33 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:35.018797 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-739739370", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "networks": [{"uuid": "785419d7-4660-46de-9f6b-0e7db4d1bf1a"}]}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:35.104016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:35.105604 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:35.106706 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] validate_networks() for [('785419d7-4660-46de-9f6b-0e7db4d1bf1a', None, None, None, None, None)] {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:42:35.123594 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:35.132084 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:35.132840 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:35.136258 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:35.137048 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:35.137644 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:35.538041 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:35.564697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:35.566396 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:35.568999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-86256150-0919-4c8b-9476-236271091864 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.473488 Aug 24 16:42:35.571273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 206/409] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:35 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:42:35.971326 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:42:35.972012 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:42:35.972722 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:42:35.973332 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:42:35.973913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:42:35.993690 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:35.994580 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:35.995048 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:35.997469 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:35.998277 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:35.999448 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:36.037737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Getting quotas for project 099d0dfa51be462e9650ab8ce50465fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:42:36.050078 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Getting quotas for user ad81d5c075d64fa8978122e124d00e19 and project 099d0dfa51be462e9650ab8ce50465fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:42:36.076761 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:42:36.083582 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:42:36.176922 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a3db969d-22b1-498f-be33-4d09be26c46a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163275 Aug 24 16:42:36.189680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9d30f266-2e55-4eae-a402-c2409b2b1517 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:36.191048 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9d30f266-2e55-4eae-a402-c2409b2b1517 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:36.195898 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 204/410] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:42:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:42:36.341289 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9d30f266-2e55-4eae-a402-c2409b2b1517 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:36.355185 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9d30f266-2e55-4eae-a402-c2409b2b1517 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1218 microversion: 2.1 time: 0.169528 Aug 24 16:42:36.367014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 207/411] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:36 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:36.597533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:36.598154 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:36.615328 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:36.617407 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:36.617894 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:36.618667 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:36.619147 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:36.621895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:36.994429 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:37.007183 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:37.009044 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:37.010959 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-50daff56-563a-4c80-9d4c-a31d742fef05 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.417622 Aug 24 16:42:37.011448 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 205/412] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:36 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:37.288868 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-670b3c10-4b30-4d29-ae7c-e41907ea1ca1 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Action: 'create', calling method: .version_select at 0x7f0641357ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1832399109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9ntUVS2Z60MU/IMAFXhFquZrZqL/Iw8CjyCwolWpiKwLlTuAvetp6E6uxzuXFO4g7+7lcSLv5/n0wqy3s6BiXdlhMzmyTiC//7ic8vunaaYm6nWim3KOC48jFGQTRfXw=="}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:37.310170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-670b3c10-4b30-4d29-ae7c-e41907ea1ca1 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Getting quotas for project 7c99de6ca9094fa7bd119a3be6817725. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:42:37.316412 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-670b3c10-4b30-4d29-ae7c-e41907ea1ca1 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Getting quotas for user bb5d3834f04142e288c04cc05665329f and project 7c99de6ca9094fa7bd119a3be6817725. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:42:37.343207 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR oslo.messaging._drivers.impl_rabbit [None req-670b3c10-4b30-4d29-ae7c-e41907ea1ca1 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [773d7d9f-b3a3-46df-b4f5-82aa33dde39b] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 16:42:37.383024 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5cc35ab7-d4d1-4ca9-8b46-d0de44a2f090 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:37.383736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5cc35ab7-d4d1-4ca9-8b46-d0de44a2f090 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:37.391452 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5cc35ab7-d4d1-4ca9-8b46-d0de44a2f090 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:37.392128 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5cc35ab7-d4d1-4ca9-8b46-d0de44a2f090 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:37.392639 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5cc35ab7-d4d1-4ca9-8b46-d0de44a2f090 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:37.393411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5cc35ab7-d4d1-4ca9-8b46-d0de44a2f090 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:37.393939 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5cc35ab7-d4d1-4ca9-8b46-d0de44a2f090 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:37.394549 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5cc35ab7-d4d1-4ca9-8b46-d0de44a2f090 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:37.464837 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5cc35ab7-d4d1-4ca9-8b46-d0de44a2f090 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:37.473345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5cc35ab7-d4d1-4ca9-8b46-d0de44a2f090 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1270 microversion: 2.1 time: 0.095249 Aug 24 16:42:37.474296 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 206/413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:37 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:42:38.037653 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:38.038278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:38.045407 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:38.046530 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:38.047078 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:38.047799 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:38.048306 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:38.048714 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:38.194046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:38.203417 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:38.205414 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:38.206782 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c5359ef4-d6fe-4ec9-8843-4060a5ba2a10 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.172997 Aug 24 16:42:38.208568 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 207/414] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:38 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:42:38.354926 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO oslo.messaging._drivers.impl_rabbit [None req-670b3c10-4b30-4d29-ae7c-e41907ea1ca1 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [773d7d9f-b3a3-46df-b4f5-82aa33dde39b] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 40086. Aug 24 16:42:38.377582 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-670b3c10-4b30-4d29-ae7c-e41907ea1ca1 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.316544 Aug 24 16:42:38.382601 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 208/415] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 16:42:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:38.497408 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2cb03e0d-19be-49bf-9b73-eb0d4b5f3f74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:38.498736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2cb03e0d-19be-49bf-9b73-eb0d4b5f3f74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:38.509397 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2cb03e0d-19be-49bf-9b73-eb0d4b5f3f74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:38.510974 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2cb03e0d-19be-49bf-9b73-eb0d4b5f3f74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:38.512226 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2cb03e0d-19be-49bf-9b73-eb0d4b5f3f74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:38.513437 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2cb03e0d-19be-49bf-9b73-eb0d4b5f3f74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:38.514386 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2cb03e0d-19be-49bf-9b73-eb0d4b5f3f74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:38.515381 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2cb03e0d-19be-49bf-9b73-eb0d4b5f3f74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:38.776145 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2cb03e0d-19be-49bf-9b73-eb0d4b5f3f74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:38.785633 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2cb03e0d-19be-49bf-9b73-eb0d4b5f3f74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1318 microversion: 2.1 time: 0.292410 Aug 24 16:42:38.797870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 208/416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:38 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:39.239228 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:39.240686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:39.248378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:39.249105 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:39.249713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:39.250846 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:39.251411 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:39.252390 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:39.260684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-90102ec5-ab50-4f20-a894-1f115e468712 req-ab70c810-79eb-44b0-bb17-284ae65f7093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80dedc7b-6a52-4870-9cf1-c4955c34e813", "tag": "b4171e1e-f4fd-4747-b163-30dfd39d308d"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:39.319092 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-90102ec5-ab50-4f20-a894-1f115e468712 req-ab70c810-79eb-44b0-bb17-284ae65f7093 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:39.319603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-90102ec5-ab50-4f20-a894-1f115e468712 req-ab70c810-79eb-44b0-bb17-284ae65f7093 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:39.321405 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-90102ec5-ab50-4f20-a894-1f115e468712 req-ab70c810-79eb-44b0-bb17-284ae65f7093 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:39.354647 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-90102ec5-ab50-4f20-a894-1f115e468712 req-ab70c810-79eb-44b0-bb17-284ae65f7093 service nova] Creating event network-changed:b4171e1e-f4fd-4747-b163-30dfd39d308d for instance 80dedc7b-6a52-4870-9cf1-c4955c34e813 on hv-cinder-77957 Aug 24 16:42:39.365650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-90102ec5-ab50-4f20-a894-1f115e468712 req-ab70c810-79eb-44b0-bb17-284ae65f7093 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115095 Aug 24 16:42:39.366287 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 209/417] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:42:39.546907 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:39.568134 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:39.569760 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:39.570970 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-919a8d18-2841-4262-88b2-2a43de038ac9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.344277 Aug 24 16:42:39.573869 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 209/418] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:39 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:39.809392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0c0ea973-9bd9-4b72-b683-59a30924c594 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:39.810096 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0c0ea973-9bd9-4b72-b683-59a30924c594 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:39.816928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0ea973-9bd9-4b72-b683-59a30924c594 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:39.817541 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0ea973-9bd9-4b72-b683-59a30924c594 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:39.818188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0ea973-9bd9-4b72-b683-59a30924c594 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:39.818901 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0ea973-9bd9-4b72-b683-59a30924c594 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:39.819361 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0ea973-9bd9-4b72-b683-59a30924c594 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:39.819904 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c0ea973-9bd9-4b72-b683-59a30924c594 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:39.991882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0c0ea973-9bd9-4b72-b683-59a30924c594 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:40.000035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0c0ea973-9bd9-4b72-b683-59a30924c594 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1318 microversion: 2.1 time: 0.195021 Aug 24 16:42:40.000843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 210/419] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:39 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:42:40.595972 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:40.596605 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:40.603972 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:40.604788 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:40.606022 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:40.607308 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:40.607987 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:40.610203 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:40.816927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:40.828588 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:40.830128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:40.831319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9bf654bd-2bbb-4b52-88e3-dd29a9f8d3c8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.240651 Aug 24 16:42:40.832104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 210/420] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:40 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:41.023634 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a0e43654-7c57-416a-ad02-c556ff6b21a9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:41.025019 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a0e43654-7c57-416a-ad02-c556ff6b21a9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:41.038544 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a0e43654-7c57-416a-ad02-c556ff6b21a9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:41.039066 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a0e43654-7c57-416a-ad02-c556ff6b21a9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:41.039501 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a0e43654-7c57-416a-ad02-c556ff6b21a9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:41.040897 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a0e43654-7c57-416a-ad02-c556ff6b21a9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:41.041520 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a0e43654-7c57-416a-ad02-c556ff6b21a9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:41.041949 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a0e43654-7c57-416a-ad02-c556ff6b21a9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:41.057341 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-b4fda3ed-97ea-4c1d-afef-70f7cc23dcfc req-3070d5a1-e0dc-40fd-b21b-f458c497eead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f46124-a6dc-4300-88a6-3143240719da", "name": "network-vif-plugged", "status": "completed", "tag": "f4013556-5bff-4eef-bfeb-7c2f27b64c4a"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:41.071569 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-b4fda3ed-97ea-4c1d-afef-70f7cc23dcfc req-3070d5a1-e0dc-40fd-b21b-f458c497eead service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:41.072372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-b4fda3ed-97ea-4c1d-afef-70f7cc23dcfc req-3070d5a1-e0dc-40fd-b21b-f458c497eead service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:41.072957 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-b4fda3ed-97ea-4c1d-afef-70f7cc23dcfc req-3070d5a1-e0dc-40fd-b21b-f458c497eead service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:41.087852 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-b4fda3ed-97ea-4c1d-afef-70f7cc23dcfc req-3070d5a1-e0dc-40fd-b21b-f458c497eead service nova] Creating event network-vif-plugged:f4013556-5bff-4eef-bfeb-7c2f27b64c4a for instance 66f46124-a6dc-4300-88a6-3143240719da on hv-cinder-77957 Aug 24 16:42:41.094563 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-b4fda3ed-97ea-4c1d-afef-70f7cc23dcfc req-3070d5a1-e0dc-40fd-b21b-f458c497eead service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042155 Aug 24 16:42:41.095159 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 211/421] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:42:41.242111 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a0e43654-7c57-416a-ad02-c556ff6b21a9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:41.250516 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a0e43654-7c57-416a-ad02-c556ff6b21a9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1318 microversion: 2.1 time: 0.232214 Aug 24 16:42:41.251258 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 211/422] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:41 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:41.856578 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:41.857280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:41.864749 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:41.865262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:41.865698 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:41.866464 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:41.866928 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:41.867350 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:42.016593 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:42.025728 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:42.027562 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:42.028732 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-abfb17a5-b7e7-4356-8da0-4b1731fce38b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.177433 Aug 24 16:42:42.029464 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 212/423] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:41 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:42.270641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4c2b15f9-886f-45e8-a006-992d5fa57982 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:42.271308 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-4c2b15f9-886f-45e8-a006-992d5fa57982 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:42.278083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c2b15f9-886f-45e8-a006-992d5fa57982 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:42.278500 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c2b15f9-886f-45e8-a006-992d5fa57982 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:42.278935 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c2b15f9-886f-45e8-a006-992d5fa57982 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:42.279639 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c2b15f9-886f-45e8-a006-992d5fa57982 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:42.280801 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c2b15f9-886f-45e8-a006-992d5fa57982 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:42.281230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c2b15f9-886f-45e8-a006-992d5fa57982 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:42.416768 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-4c2b15f9-886f-45e8-a006-992d5fa57982 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:42.424912 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-4c2b15f9-886f-45e8-a006-992d5fa57982 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1318 microversion: 2.1 time: 0.158057 Aug 24 16:42:42.425503 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 212/424] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:42 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:42:43.052347 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:43.053050 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:43.059193 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:43.059691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:43.060145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:43.060840 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:43.062181 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:43.062756 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:43.198823 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:43.208598 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:43.210608 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:43.212618 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-77029165-5444-4476-b04f-04ac036b6802 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.164085 Aug 24 16:42:43.213885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 213/425] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:43 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:43.446124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ac04d428-8ae3-4045-be40-b3d32f72bc74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:43.446895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ac04d428-8ae3-4045-be40-b3d32f72bc74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:43.454365 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac04d428-8ae3-4045-be40-b3d32f72bc74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:43.454856 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac04d428-8ae3-4045-be40-b3d32f72bc74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:43.455492 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac04d428-8ae3-4045-be40-b3d32f72bc74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:43.457093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac04d428-8ae3-4045-be40-b3d32f72bc74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:43.457767 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac04d428-8ae3-4045-be40-b3d32f72bc74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:43.458262 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ac04d428-8ae3-4045-be40-b3d32f72bc74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:43.611919 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ac04d428-8ae3-4045-be40-b3d32f72bc74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:43.619977 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ac04d428-8ae3-4045-be40-b3d32f72bc74 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1318 microversion: 2.1 time: 0.177709 Aug 24 16:42:43.620777 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 213/426] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:43 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:44.236128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:44.236897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:44.243850 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:44.244611 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:44.245136 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:44.245922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:44.246801 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:44.247454 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:44.407319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:44.416929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:44.418663 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:44.420140 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e8c9793c-e3a8-43a5-ac4f-6da8e112697d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.187965 Aug 24 16:42:44.424268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 214/427] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:44 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:44.643093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-07710747-bdc0-4b43-9cb7-c8788a10beb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:44.644330 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-07710747-bdc0-4b43-9cb7-c8788a10beb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:44.651065 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-07710747-bdc0-4b43-9cb7-c8788a10beb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:44.651555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-07710747-bdc0-4b43-9cb7-c8788a10beb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:44.652007 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-07710747-bdc0-4b43-9cb7-c8788a10beb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:44.652716 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-07710747-bdc0-4b43-9cb7-c8788a10beb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:44.653156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-07710747-bdc0-4b43-9cb7-c8788a10beb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:44.653568 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-07710747-bdc0-4b43-9cb7-c8788a10beb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:44.818022 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-07710747-bdc0-4b43-9cb7-c8788a10beb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:44.825779 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-07710747-bdc0-4b43-9cb7-c8788a10beb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1318 microversion: 2.1 time: 0.187040 Aug 24 16:42:44.826342 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 214/428] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:44 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:44.892294 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-52379f03-2ac9-4592-b420-87047196b932 req-7aeb9860-173f-44d4-ba44-4c060ff61fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80dedc7b-6a52-4870-9cf1-c4955c34e813", "name": "network-vif-plugged", "status": "completed", "tag": "b4171e1e-f4fd-4747-b163-30dfd39d308d"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:44.902259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-52379f03-2ac9-4592-b420-87047196b932 req-7aeb9860-173f-44d4-ba44-4c060ff61fa1 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:44.903744 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-52379f03-2ac9-4592-b420-87047196b932 req-7aeb9860-173f-44d4-ba44-4c060ff61fa1 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:44.904478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-52379f03-2ac9-4592-b420-87047196b932 req-7aeb9860-173f-44d4-ba44-4c060ff61fa1 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:44.917890 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-52379f03-2ac9-4592-b420-87047196b932 req-7aeb9860-173f-44d4-ba44-4c060ff61fa1 service nova] Creating event network-vif-plugged:b4171e1e-f4fd-4747-b163-30dfd39d308d for instance 80dedc7b-6a52-4870-9cf1-c4955c34e813 on hv-cinder-77957 Aug 24 16:42:44.926386 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-52379f03-2ac9-4592-b420-87047196b932 req-7aeb9860-173f-44d4-ba44-4c060ff61fa1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038678 Aug 24 16:42:44.927688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 215/429] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:42:45.443306 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:45.443841 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:45.451356 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:45.451980 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:45.452396 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:45.453105 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:45.453563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:45.453987 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:45.598321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:45.606999 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:45.609158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:45.610310 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d8ebe06f-ed2c-4e91-87e4-47f2d5f2c3bd tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1806 microversion: 2.20 time: 0.171019 Aug 24 16:42:45.610861 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 215/430] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:45 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:45.848388 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a5660a3f-65e9-4324-9cef-e743fedb081b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:45.849005 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a5660a3f-65e9-4324-9cef-e743fedb081b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:45.855084 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5660a3f-65e9-4324-9cef-e743fedb081b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:45.855562 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5660a3f-65e9-4324-9cef-e743fedb081b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:45.856017 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5660a3f-65e9-4324-9cef-e743fedb081b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:45.856703 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5660a3f-65e9-4324-9cef-e743fedb081b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:45.857158 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5660a3f-65e9-4324-9cef-e743fedb081b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:45.857578 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a5660a3f-65e9-4324-9cef-e743fedb081b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:45.861344 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=85 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:45.993814 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a5660a3f-65e9-4324-9cef-e743fedb081b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:46.003563 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a5660a3f-65e9-4324-9cef-e743fedb081b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1318 microversion: 2.1 time: 0.159609 Aug 24 16:42:46.004249 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 216/431] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:45 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:46.637801 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:46.638414 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:46.641370 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:46.642039 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=10 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:46.648645 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:46.649127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:46.649562 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:46.650258 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:46.650964 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:46.651387 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:46.801473 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:46.810722 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:46.812966 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:46.814151 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-865cd0fc-328c-44d0-8d53-189d688b40b6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1793 microversion: 2.20 time: 0.180384 Aug 24 16:42:46.814713 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 216/432] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:42:46 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1793 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:42:47.026191 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d1f253b7-acc5-4165-a962-eab8df5a1afe tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:47.026794 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d1f253b7-acc5-4165-a962-eab8df5a1afe tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:47.034654 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d1f253b7-acc5-4165-a962-eab8df5a1afe tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:47.035737 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d1f253b7-acc5-4165-a962-eab8df5a1afe tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:47.035737 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d1f253b7-acc5-4165-a962-eab8df5a1afe tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:47.036544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d1f253b7-acc5-4165-a962-eab8df5a1afe tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:47.037063 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d1f253b7-acc5-4165-a962-eab8df5a1afe tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:47.037650 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d1f253b7-acc5-4165-a962-eab8df5a1afe tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:47.174522 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d1f253b7-acc5-4165-a962-eab8df5a1afe tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:47.182259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d1f253b7-acc5-4165-a962-eab8df5a1afe tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1508 microversion: 2.1 time: 0.160231 Aug 24 16:42:47.182822 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 217/433] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:47 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:50.708128 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-61386899", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-501083313", "security_groups": [{"name": "tempest-secgroup-smoke-1335303825"}], "networks": [{"uuid": "74205911-f3ba-46da-bdb9-bfd524beaaea"}], "block_device_mapping_v2": [{"uuid": "37e9e11b-188c-4cc3-9e38-4e4e5a1cfb89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:50.822395 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] validate_networks() for [('74205911-f3ba-46da-bdb9-bfd524beaaea', None, None, None, None, None)] {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:42:51.218409 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:42:51.218830 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:42:51.219305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:42:51.219711 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:42:51.220161 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:42:51.229168 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:51.229642 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:51.230066 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:51.230783 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:51.231228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:51.231641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:51.250816 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Getting quotas for project cd41122fd4e94aa786798d8f54214f0a. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:42:51.255817 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Getting quotas for user 9fb81fa5765c44a0afa8d9fb4786272c and project cd41122fd4e94aa786798d8f54214f0a. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:42:51.314680 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:42:51.316971 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37e9e11b-188c-4cc3-9e38-4e4e5a1cfb89',volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:42:51.455410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5120426e-7c4e-4d66-9555-a4e7a04b680f tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.752903 Aug 24 16:42:51.456358 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 217/434] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:42:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:42:51.466880 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-93f15aa3-7815-4b90-a953-a7dc9c572347 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:51.468459 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-93f15aa3-7815-4b90-a953-a7dc9c572347 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:51.470483 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=6 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:51.536065 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-93f15aa3-7815-4b90-a953-a7dc9c572347 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:51.543560 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-93f15aa3-7815-4b90-a953-a7dc9c572347 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1086 microversion: 2.1 time: 0.080476 Aug 24 16:42:51.544144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 218/435] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:51 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1086 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:42:52.565162 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7a8c1bcb-9a32-4e98-aa78-7df90c2018b9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:52.565724 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-7a8c1bcb-9a32-4e98-aa78-7df90c2018b9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:52.571791 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a8c1bcb-9a32-4e98-aa78-7df90c2018b9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:52.572493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a8c1bcb-9a32-4e98-aa78-7df90c2018b9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:52.572918 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a8c1bcb-9a32-4e98-aa78-7df90c2018b9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:52.573603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a8c1bcb-9a32-4e98-aa78-7df90c2018b9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:52.574054 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a8c1bcb-9a32-4e98-aa78-7df90c2018b9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:52.574466 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a8c1bcb-9a32-4e98-aa78-7df90c2018b9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:52.642355 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-7a8c1bcb-9a32-4e98-aa78-7df90c2018b9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:52.651971 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7a8c1bcb-9a32-4e98-aa78-7df90c2018b9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1192 microversion: 2.1 time: 0.091233 Aug 24 16:42:52.652557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 218/436] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:52 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:53.674740 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9f3b5213-ae25-447a-8b46-5585ad16d869 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:53.675269 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9f3b5213-ae25-447a-8b46-5585ad16d869 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:53.677697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:53.683315 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3b5213-ae25-447a-8b46-5585ad16d869 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:53.683831 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3b5213-ae25-447a-8b46-5585ad16d869 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:53.684303 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3b5213-ae25-447a-8b46-5585ad16d869 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:53.685045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3b5213-ae25-447a-8b46-5585ad16d869 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:53.685745 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3b5213-ae25-447a-8b46-5585ad16d869 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:53.686467 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f3b5213-ae25-447a-8b46-5585ad16d869 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:53.986327 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-1328779e-4a1e-406f-8e84-f04b8a7cda38 req-6f4e50c3-21ee-44e9-886a-9cb73aa82c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e451e3e-9a42-40af-aff5-e8f8938252db", "tag": "bdb45216-e99f-41b9-b9d6-611a8882cee0"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:42:54.010257 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-1328779e-4a1e-406f-8e84-f04b8a7cda38 req-6f4e50c3-21ee-44e9-886a-9cb73aa82c53 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:54.010998 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-1328779e-4a1e-406f-8e84-f04b8a7cda38 req-6f4e50c3-21ee-44e9-886a-9cb73aa82c53 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:54.011534 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-1328779e-4a1e-406f-8e84-f04b8a7cda38 req-6f4e50c3-21ee-44e9-886a-9cb73aa82c53 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:54.035166 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-1328779e-4a1e-406f-8e84-f04b8a7cda38 req-6f4e50c3-21ee-44e9-886a-9cb73aa82c53 service nova] Creating event network-changed:bdb45216-e99f-41b9-b9d6-611a8882cee0 for instance 8e451e3e-9a42-40af-aff5-e8f8938252db on hv-cinder-77957 Aug 24 16:42:54.041340 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-1328779e-4a1e-406f-8e84-f04b8a7cda38 req-6f4e50c3-21ee-44e9-886a-9cb73aa82c53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061207 Aug 24 16:42:54.041940 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 219/437] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:42:54.077537 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9f3b5213-ae25-447a-8b46-5585ad16d869 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:54.086373 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9f3b5213-ae25-447a-8b46-5585ad16d869 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.416147 Aug 24 16:42:54.086906 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 219/438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:53 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:55.114727 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-48ef9015-4f9c-4382-94f9-67d70eba0059 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:55.116192 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-48ef9015-4f9c-4382-94f9-67d70eba0059 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:55.121947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-48ef9015-4f9c-4382-94f9-67d70eba0059 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:55.122616 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-48ef9015-4f9c-4382-94f9-67d70eba0059 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:55.123120 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-48ef9015-4f9c-4382-94f9-67d70eba0059 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:55.124710 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-48ef9015-4f9c-4382-94f9-67d70eba0059 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:55.125405 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-48ef9015-4f9c-4382-94f9-67d70eba0059 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:55.126440 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-48ef9015-4f9c-4382-94f9-67d70eba0059 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:55.131339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=100 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:55.271546 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-48ef9015-4f9c-4382-94f9-67d70eba0059 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:55.280591 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-48ef9015-4f9c-4382-94f9-67d70eba0059 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.169149 Aug 24 16:42:55.280844 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 220/439] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:55 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:56.303609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-55b8f9f9-6be8-4494-a025-bbe989cf6a21 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:56.304197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-55b8f9f9-6be8-4494-a025-bbe989cf6a21 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:56.310542 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-55b8f9f9-6be8-4494-a025-bbe989cf6a21 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:56.311187 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-55b8f9f9-6be8-4494-a025-bbe989cf6a21 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:56.311626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-55b8f9f9-6be8-4494-a025-bbe989cf6a21 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:56.312350 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-55b8f9f9-6be8-4494-a025-bbe989cf6a21 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:56.312806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-55b8f9f9-6be8-4494-a025-bbe989cf6a21 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:56.313230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-55b8f9f9-6be8-4494-a025-bbe989cf6a21 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:56.448769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-55b8f9f9-6be8-4494-a025-bbe989cf6a21 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:56.457619 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-55b8f9f9-6be8-4494-a025-bbe989cf6a21 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.157835 Aug 24 16:42:56.458180 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 220/440] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:56 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:57.478738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9d0570a5-7357-4547-b20f-490465bcb687 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:57.479557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9d0570a5-7357-4547-b20f-490465bcb687 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:57.483354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=7 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:57.487632 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9d0570a5-7357-4547-b20f-490465bcb687 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:57.488150 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9d0570a5-7357-4547-b20f-490465bcb687 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:57.488586 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9d0570a5-7357-4547-b20f-490465bcb687 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:57.489288 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9d0570a5-7357-4547-b20f-490465bcb687 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:57.489773 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9d0570a5-7357-4547-b20f-490465bcb687 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:57.490191 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9d0570a5-7357-4547-b20f-490465bcb687 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:57.622504 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9d0570a5-7357-4547-b20f-490465bcb687 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:57.631156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9d0570a5-7357-4547-b20f-490465bcb687 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.156139 Aug 24 16:42:57.631737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 221/441] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:57 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:58.652254 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f6310f5c-45b5-404a-9eac-e0c2ca32f747 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:58.652866 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f6310f5c-45b5-404a-9eac-e0c2ca32f747 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:58.659753 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6310f5c-45b5-404a-9eac-e0c2ca32f747 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:58.660270 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6310f5c-45b5-404a-9eac-e0c2ca32f747 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:58.660725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6310f5c-45b5-404a-9eac-e0c2ca32f747 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:58.661463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6310f5c-45b5-404a-9eac-e0c2ca32f747 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:58.661907 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6310f5c-45b5-404a-9eac-e0c2ca32f747 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:58.662322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f6310f5c-45b5-404a-9eac-e0c2ca32f747 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:58.799827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f6310f5c-45b5-404a-9eac-e0c2ca32f747 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:58.811265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f6310f5c-45b5-404a-9eac-e0c2ca32f747 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.162298 Aug 24 16:42:58.812025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 221/442] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:58 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:42:59.836731 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-abf0f909-f5d8-46b6-af25-d304a81d15f0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:42:59.837343 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-abf0f909-f5d8-46b6-af25-d304a81d15f0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:42:59.844075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf0f909-f5d8-46b6-af25-d304a81d15f0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:59.844561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf0f909-f5d8-46b6-af25-d304a81d15f0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:59.844997 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf0f909-f5d8-46b6-af25-d304a81d15f0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:59.845694 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf0f909-f5d8-46b6-af25-d304a81d15f0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:42:59.846149 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf0f909-f5d8-46b6-af25-d304a81d15f0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:42:59.846574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf0f909-f5d8-46b6-af25-d304a81d15f0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:42:59.981275 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-abf0f909-f5d8-46b6-af25-d304a81d15f0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:42:59.989632 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-abf0f909-f5d8-46b6-af25-d304a81d15f0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.156774 Aug 24 16:42:59.990227 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 222/443] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:42:59 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:00.878494 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8ac0e303-00dd-4e4c-9c6c-c55716864277 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "242b3fc2-0394-4aee-9406-d2d23c5d8c5f"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:00.880884 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8ac0e303-00dd-4e4c-9c6c-c55716864277 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:00.887188 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ac0e303-00dd-4e4c-9c6c-c55716864277 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:00.887669 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ac0e303-00dd-4e4c-9c6c-c55716864277 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:00.888145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ac0e303-00dd-4e4c-9c6c-c55716864277 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:00.889417 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ac0e303-00dd-4e4c-9c6c-c55716864277 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:00.889872 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ac0e303-00dd-4e4c-9c6c-c55716864277 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:00.890291 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8ac0e303-00dd-4e4c-9c6c-c55716864277 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:01.011107 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-be511bb1-1de2-4fc1-9942-8c45a4bbc269 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:01.011834 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-be511bb1-1de2-4fc1-9942-8c45a4bbc269 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:01.019042 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be511bb1-1de2-4fc1-9942-8c45a4bbc269 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:01.019560 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be511bb1-1de2-4fc1-9942-8c45a4bbc269 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:01.021154 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be511bb1-1de2-4fc1-9942-8c45a4bbc269 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:01.021999 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be511bb1-1de2-4fc1-9942-8c45a4bbc269 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:01.022539 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be511bb1-1de2-4fc1-9942-8c45a4bbc269 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:01.023039 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be511bb1-1de2-4fc1-9942-8c45a4bbc269 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:01.151776 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8ac0e303-00dd-4e4c-9c6c-c55716864277 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277093 Aug 24 16:43:01.158422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 222/444] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:43:00 2022] POST /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:01.175127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-be511bb1-1de2-4fc1-9942-8c45a4bbc269 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:01.183167 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-be511bb1-1de2-4fc1-9942-8c45a4bbc269 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.176676 Aug 24 16:43:01.183743 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 223/445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:01 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:01.637319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:01.642750 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-956710055", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1832399109", "security_groups": [{"name": "tempest-secgroup-smoke-1681464898"}], "block_device_mapping_v2": [{"uuid": "a6296d00-db00-45b1-af04-7f43918e1c35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3e014ccf-9e98-4c79-acd6-45f0ecc3f7d2"}]}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:01.759847 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] validate_networks() for [('3e014ccf-9e98-4c79-acd6-45f0ecc3f7d2', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:43:02.150926 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:43:02.151499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:43:02.151816 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:43:02.152284 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:43:02.152684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:43:02.161843 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:02.162365 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:02.162992 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:02.163746 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:02.164235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:02.164658 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:02.181866 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Getting quotas for project 7c99de6ca9094fa7bd119a3be6817725. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:43:02.186331 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Getting quotas for user bb5d3834f04142e288c04cc05665329f and project 7c99de6ca9094fa7bd119a3be6817725. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:43:02.204687 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e100c795-a82e-4d5f-b672-684127413c06 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:02.205820 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e100c795-a82e-4d5f-b672-684127413c06 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:02.208927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:02.209581 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=6 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:02.214417 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e100c795-a82e-4d5f-b672-684127413c06 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:02.214957 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e100c795-a82e-4d5f-b672-684127413c06 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:02.215346 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e100c795-a82e-4d5f-b672-684127413c06 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:02.216071 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e100c795-a82e-4d5f-b672-684127413c06 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:02.217262 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e100c795-a82e-4d5f-b672-684127413c06 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:02.217523 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e100c795-a82e-4d5f-b672-684127413c06 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:02.248765 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:43:02.250974 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6296d00-db00-45b1-af04-7f43918e1c35',volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:43:02.364047 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e100c795-a82e-4d5f-b672-684127413c06 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:02.373299 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e100c795-a82e-4d5f-b672-684127413c06 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.172441 Aug 24 16:43:02.374670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 224/446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:02 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:02.401241 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7739acd6-b80a-47b2-893b-34558c5753ba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765739 Aug 24 16:43:02.402674 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 223/447] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:43:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:43:02.419774 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-98c4ee82-cbfc-4fe9-991d-4d9138fb64a6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:02.421059 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-98c4ee82-cbfc-4fe9-991d-4d9138fb64a6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:02.475001 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-98c4ee82-cbfc-4fe9-991d-4d9138fb64a6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:02.483243 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-98c4ee82-cbfc-4fe9-991d-4d9138fb64a6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1094 microversion: 2.1 time: 0.067468 Aug 24 16:43:02.483820 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 225/448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:02 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:03.399055 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-14fbea8c-cdd6-47e9-883a-5b486cbaecf5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:03.399839 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-14fbea8c-cdd6-47e9-883a-5b486cbaecf5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:03.406623 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-14fbea8c-cdd6-47e9-883a-5b486cbaecf5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:03.407247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-14fbea8c-cdd6-47e9-883a-5b486cbaecf5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:03.407752 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-14fbea8c-cdd6-47e9-883a-5b486cbaecf5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:03.408554 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-14fbea8c-cdd6-47e9-883a-5b486cbaecf5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:03.409211 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-14fbea8c-cdd6-47e9-883a-5b486cbaecf5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:03.409717 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-14fbea8c-cdd6-47e9-883a-5b486cbaecf5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:03.504031 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-361e2bd9-ada4-4f9a-9cf9-8e0136a45dee tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:03.504709 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-361e2bd9-ada4-4f9a-9cf9-8e0136a45dee tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:03.517607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-361e2bd9-ada4-4f9a-9cf9-8e0136a45dee tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:03.518108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-361e2bd9-ada4-4f9a-9cf9-8e0136a45dee tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:03.518551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-361e2bd9-ada4-4f9a-9cf9-8e0136a45dee tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:03.525755 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-361e2bd9-ada4-4f9a-9cf9-8e0136a45dee tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:03.526389 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-361e2bd9-ada4-4f9a-9cf9-8e0136a45dee tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:03.526835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-361e2bd9-ada4-4f9a-9cf9-8e0136a45dee tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:03.640932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-361e2bd9-ada4-4f9a-9cf9-8e0136a45dee tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:03.649547 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-361e2bd9-ada4-4f9a-9cf9-8e0136a45dee tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1200 microversion: 2.1 time: 0.149244 Aug 24 16:43:03.650932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 226/449] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:03 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1200 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:03.677123 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-14fbea8c-cdd6-47e9-883a-5b486cbaecf5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:03.687444 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-14fbea8c-cdd6-47e9-883a-5b486cbaecf5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.292027 Aug 24 16:43:03.688155 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 224/450] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:03 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:04.670884 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9bbf4361-7311-4f36-b3fa-328b68e9a33e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:04.671486 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9bbf4361-7311-4f36-b3fa-328b68e9a33e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:04.677659 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9bbf4361-7311-4f36-b3fa-328b68e9a33e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:04.678140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9bbf4361-7311-4f36-b3fa-328b68e9a33e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:04.678566 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9bbf4361-7311-4f36-b3fa-328b68e9a33e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:04.679254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9bbf4361-7311-4f36-b3fa-328b68e9a33e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:04.679702 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9bbf4361-7311-4f36-b3fa-328b68e9a33e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:04.680147 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9bbf4361-7311-4f36-b3fa-328b68e9a33e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:04.710011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-000c59ba-d30a-4b6f-8053-734dfe93f335 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:04.711144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-000c59ba-d30a-4b6f-8053-734dfe93f335 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:04.719810 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-000c59ba-d30a-4b6f-8053-734dfe93f335 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:04.720576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-000c59ba-d30a-4b6f-8053-734dfe93f335 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:04.721187 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-000c59ba-d30a-4b6f-8053-734dfe93f335 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:04.722385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-000c59ba-d30a-4b6f-8053-734dfe93f335 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:04.723493 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-000c59ba-d30a-4b6f-8053-734dfe93f335 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:04.724147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-000c59ba-d30a-4b6f-8053-734dfe93f335 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:04.871529 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9bbf4361-7311-4f36-b3fa-328b68e9a33e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:04.886281 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9bbf4361-7311-4f36-b3fa-328b68e9a33e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1278 microversion: 2.1 time: 0.219239 Aug 24 16:43:04.887711 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 227/451] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:04 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:04.912944 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-a3119049-2924-4008-b9bc-1bb876c69e08 req-e3a698b5-8633-4bc8-a88c-2059be34e8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ba5c9b-d3ec-4458-9ad3-eefdc9882599", "tag": "7e3be820-ac99-48f6-a3cd-ea4af916ff3b"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:04.939727 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a3119049-2924-4008-b9bc-1bb876c69e08 req-e3a698b5-8633-4bc8-a88c-2059be34e8b5 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:04.940285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a3119049-2924-4008-b9bc-1bb876c69e08 req-e3a698b5-8633-4bc8-a88c-2059be34e8b5 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:04.940896 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a3119049-2924-4008-b9bc-1bb876c69e08 req-e3a698b5-8633-4bc8-a88c-2059be34e8b5 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:04.943288 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-000c59ba-d30a-4b6f-8053-734dfe93f335 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:04.955332 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-a3119049-2924-4008-b9bc-1bb876c69e08 req-e3a698b5-8633-4bc8-a88c-2059be34e8b5 service nova] Creating event network-changed:7e3be820-ac99-48f6-a3cd-ea4af916ff3b for instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 on hv-cinder-77957 Aug 24 16:43:04.960618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-a3119049-2924-4008-b9bc-1bb876c69e08 req-e3a698b5-8633-4bc8-a88c-2059be34e8b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053841 Aug 24 16:43:04.961668 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 228/452] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:04.968261 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-f4a037a4-2bea-4fa8-bec2-338ee6702a5a req-4b20e79e-1ff4-484b-a283-ff203b79f5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e451e3e-9a42-40af-aff5-e8f8938252db", "name": "network-vif-plugged", "status": "completed", "tag": "bdb45216-e99f-41b9-b9d6-611a8882cee0"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:04.971026 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-000c59ba-d30a-4b6f-8053-734dfe93f335 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.266326 Aug 24 16:43:04.971780 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 225/453] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:04 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:04.979503 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-f4a037a4-2bea-4fa8-bec2-338ee6702a5a req-4b20e79e-1ff4-484b-a283-ff203b79f5f2 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:04.980098 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-f4a037a4-2bea-4fa8-bec2-338ee6702a5a req-4b20e79e-1ff4-484b-a283-ff203b79f5f2 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:04.980613 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-f4a037a4-2bea-4fa8-bec2-338ee6702a5a req-4b20e79e-1ff4-484b-a283-ff203b79f5f2 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:04.992942 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-f4a037a4-2bea-4fa8-bec2-338ee6702a5a req-4b20e79e-1ff4-484b-a283-ff203b79f5f2 service nova] Creating event network-vif-plugged:bdb45216-e99f-41b9-b9d6-611a8882cee0 for instance 8e451e3e-9a42-40af-aff5-e8f8938252db on hv-cinder-77957 Aug 24 16:43:04.998482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-f4a037a4-2bea-4fa8-bec2-338ee6702a5a req-4b20e79e-1ff4-484b-a283-ff203b79f5f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034523 Aug 24 16:43:04.999621 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 229/454] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:05.909833 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8236df9f-7b35-4fa1-9e86-250afdf53add tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:05.910478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8236df9f-7b35-4fa1-9e86-250afdf53add tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:05.916790 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8236df9f-7b35-4fa1-9e86-250afdf53add tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:05.917273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8236df9f-7b35-4fa1-9e86-250afdf53add tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:05.917705 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8236df9f-7b35-4fa1-9e86-250afdf53add tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:05.918388 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8236df9f-7b35-4fa1-9e86-250afdf53add tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:05.918840 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8236df9f-7b35-4fa1-9e86-250afdf53add tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:05.919264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8236df9f-7b35-4fa1-9e86-250afdf53add tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:05.992724 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-38f3745e-3dfe-4f60-962b-b07a2f60c881 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:05.993424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-38f3745e-3dfe-4f60-962b-b07a2f60c881 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:06.000384 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-38f3745e-3dfe-4f60-962b-b07a2f60c881 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:06.001206 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-38f3745e-3dfe-4f60-962b-b07a2f60c881 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:06.001372 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-38f3745e-3dfe-4f60-962b-b07a2f60c881 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:06.001989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-38f3745e-3dfe-4f60-962b-b07a2f60c881 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:06.002760 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-38f3745e-3dfe-4f60-962b-b07a2f60c881 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:06.003191 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-38f3745e-3dfe-4f60-962b-b07a2f60c881 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:06.085836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8236df9f-7b35-4fa1-9e86-250afdf53add tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:06.094654 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8236df9f-7b35-4fa1-9e86-250afdf53add tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1278 microversion: 2.1 time: 0.188620 Aug 24 16:43:06.095227 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 226/455] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:05 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:06.158310 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-38f3745e-3dfe-4f60-962b-b07a2f60c881 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:06.165975 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-38f3745e-3dfe-4f60-962b-b07a2f60c881 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.177553 Aug 24 16:43:06.166541 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 230/456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:05 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:07.115312 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-aaeb973b-4224-4aae-8672-91dabdeea38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:07.115925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-aaeb973b-4224-4aae-8672-91dabdeea38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:07.122639 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aaeb973b-4224-4aae-8672-91dabdeea38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:07.123658 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aaeb973b-4224-4aae-8672-91dabdeea38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:07.124548 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aaeb973b-4224-4aae-8672-91dabdeea38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:07.126161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aaeb973b-4224-4aae-8672-91dabdeea38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:07.126617 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aaeb973b-4224-4aae-8672-91dabdeea38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:07.127031 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aaeb973b-4224-4aae-8672-91dabdeea38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:07.187641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-89c34874-4361-42cd-a14f-717ec0c1ee17 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:07.188267 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-89c34874-4361-42cd-a14f-717ec0c1ee17 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:07.194345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89c34874-4361-42cd-a14f-717ec0c1ee17 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:07.194833 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89c34874-4361-42cd-a14f-717ec0c1ee17 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:07.195266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89c34874-4361-42cd-a14f-717ec0c1ee17 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:07.195975 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89c34874-4361-42cd-a14f-717ec0c1ee17 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:07.196601 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89c34874-4361-42cd-a14f-717ec0c1ee17 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:07.197021 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-89c34874-4361-42cd-a14f-717ec0c1ee17 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:07.293423 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-aaeb973b-4224-4aae-8672-91dabdeea38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:07.302120 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-aaeb973b-4224-4aae-8672-91dabdeea38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1278 microversion: 2.1 time: 0.190595 Aug 24 16:43:07.302711 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 227/457] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:07 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:07.375403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-89c34874-4361-42cd-a14f-717ec0c1ee17 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:07.383140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-89c34874-4361-42cd-a14f-717ec0c1ee17 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1258 microversion: 2.1 time: 0.200306 Aug 24 16:43:07.383703 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 231/458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:07 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:08.325726 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8a6fe420-1b95-4f8b-8a98-58750365318c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:08.326871 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8a6fe420-1b95-4f8b-8a98-58750365318c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:08.333361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a6fe420-1b95-4f8b-8a98-58750365318c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.333925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a6fe420-1b95-4f8b-8a98-58750365318c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.334441 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a6fe420-1b95-4f8b-8a98-58750365318c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.335201 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a6fe420-1b95-4f8b-8a98-58750365318c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.335646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a6fe420-1b95-4f8b-8a98-58750365318c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.336089 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a6fe420-1b95-4f8b-8a98-58750365318c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.404211 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-85486c4c-d648-4625-b9b8-99e12676b1f4 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:08.404847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-85486c4c-d648-4625-b9b8-99e12676b1f4 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:08.411893 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85486c4c-d648-4625-b9b8-99e12676b1f4 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.412419 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85486c4c-d648-4625-b9b8-99e12676b1f4 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.412855 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85486c4c-d648-4625-b9b8-99e12676b1f4 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.413563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85486c4c-d648-4625-b9b8-99e12676b1f4 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.414017 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85486c4c-d648-4625-b9b8-99e12676b1f4 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.414435 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85486c4c-d648-4625-b9b8-99e12676b1f4 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.511611 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8a6fe420-1b95-4f8b-8a98-58750365318c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:08.523014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8a6fe420-1b95-4f8b-8a98-58750365318c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1278 microversion: 2.1 time: 0.201071 Aug 24 16:43:08.523656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 228/459] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:08 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:08.581882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-85486c4c-d648-4625-b9b8-99e12676b1f4 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:08.592142 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-85486c4c-d648-4625-b9b8-99e12676b1f4 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1442 microversion: 2.1 time: 0.192060 Aug 24 16:43:08.593045 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 232/460] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:08 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1442 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:08.613342 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-77eb6ef8-86a0-4db6-ab08-b61f370752e5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:08.613957 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-77eb6ef8-86a0-4db6-ab08-b61f370752e5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:08.619781 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77eb6ef8-86a0-4db6-ab08-b61f370752e5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.620329 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77eb6ef8-86a0-4db6-ab08-b61f370752e5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.620769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77eb6ef8-86a0-4db6-ab08-b61f370752e5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.621472 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77eb6ef8-86a0-4db6-ab08-b61f370752e5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.622046 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77eb6ef8-86a0-4db6-ab08-b61f370752e5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.622356 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-77eb6ef8-86a0-4db6-ab08-b61f370752e5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.715976 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-911cb1ad-c291-4a31-8550-ef04b169901f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:08.718692 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-911cb1ad-c291-4a31-8550-ef04b169901f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:08.724637 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-911cb1ad-c291-4a31-8550-ef04b169901f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.725119 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-911cb1ad-c291-4a31-8550-ef04b169901f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.725550 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-911cb1ad-c291-4a31-8550-ef04b169901f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.726235 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-911cb1ad-c291-4a31-8550-ef04b169901f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.726860 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-911cb1ad-c291-4a31-8550-ef04b169901f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.727280 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-911cb1ad-c291-4a31-8550-ef04b169901f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.753988 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-911cb1ad-c291-4a31-8550-ef04b169901f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lazy-loading 'flavor' on Instance uuid f0aa7b07-8c79-4568-af26-cc2273f85a11 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:43:08.761187 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-77eb6ef8-86a0-4db6-ab08-b61f370752e5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:08.783206 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-77eb6ef8-86a0-4db6-ab08-b61f370752e5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1442 microversion: 2.1 time: 0.173546 Aug 24 16:43:08.784080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 229/461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:08 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1442 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:08.789281 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-22181d3f-a54e-4e42-acf5-63e2a360dc77 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3385c99-9382-4398-ac33-029a86445f32", "device": "/dev/sdb"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:08.793833 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-22181d3f-a54e-4e42-acf5-63e2a360dc77 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:08.801759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22181d3f-a54e-4e42-acf5-63e2a360dc77 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.802244 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22181d3f-a54e-4e42-acf5-63e2a360dc77 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.802670 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22181d3f-a54e-4e42-acf5-63e2a360dc77 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.803358 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22181d3f-a54e-4e42-acf5-63e2a360dc77 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.803987 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22181d3f-a54e-4e42-acf5-63e2a360dc77 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.804609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-22181d3f-a54e-4e42-acf5-63e2a360dc77 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.921455 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-911cb1ad-c291-4a31-8550-ef04b169901f tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/action" status: 200 len: 32 microversion: 2.1 time: 0.209384 Aug 24 16:43:08.922331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 233/462] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:43:08 2022] POST /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 16:43:08.941509 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-11a99111-7f95-4fe6-ac6d-1f90916cfb6e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:08.942260 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-11a99111-7f95-4fe6-ac6d-1f90916cfb6e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:08.956930 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11a99111-7f95-4fe6-ac6d-1f90916cfb6e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.958052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11a99111-7f95-4fe6-ac6d-1f90916cfb6e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.958052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11a99111-7f95-4fe6-ac6d-1f90916cfb6e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:08.958843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11a99111-7f95-4fe6-ac6d-1f90916cfb6e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:08.959315 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11a99111-7f95-4fe6-ac6d-1f90916cfb6e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:08.959747 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-11a99111-7f95-4fe6-ac6d-1f90916cfb6e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:09.226667 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-22181d3f-a54e-4e42-acf5-63e2a360dc77 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "POST /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440845 Aug 24 16:43:09.228061 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 230/463] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:43:08 2022] POST /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:09.229389 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-11a99111-7f95-4fe6-ac6d-1f90916cfb6e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:09.243917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-11a99111-7f95-4fe6-ac6d-1f90916cfb6e tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.314858 Aug 24 16:43:09.248294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 234/464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:08 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:09.546206 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f73b4c33-e166-4321-809f-9d6c5b90b26d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:09.546895 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f73b4c33-e166-4321-809f-9d6c5b90b26d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:09.553315 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f73b4c33-e166-4321-809f-9d6c5b90b26d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:09.553873 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f73b4c33-e166-4321-809f-9d6c5b90b26d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:09.554310 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f73b4c33-e166-4321-809f-9d6c5b90b26d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:09.555010 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f73b4c33-e166-4321-809f-9d6c5b90b26d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:09.555492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f73b4c33-e166-4321-809f-9d6c5b90b26d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:09.555914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f73b4c33-e166-4321-809f-9d6c5b90b26d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:09.805318 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f73b4c33-e166-4321-809f-9d6c5b90b26d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:09.813459 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:09.817143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f73b4c33-e166-4321-809f-9d6c5b90b26d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.276102 Aug 24 16:43:09.818315 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 231/465] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:09 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:10.271032 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-826424ba-4160-4c0e-9f18-d0b1d3e1ee63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:10.271650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-826424ba-4160-4c0e-9f18-d0b1d3e1ee63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:10.278615 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-826424ba-4160-4c0e-9f18-d0b1d3e1ee63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:10.279905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-826424ba-4160-4c0e-9f18-d0b1d3e1ee63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:10.280445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-826424ba-4160-4c0e-9f18-d0b1d3e1ee63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:10.281236 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-826424ba-4160-4c0e-9f18-d0b1d3e1ee63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:10.281708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-826424ba-4160-4c0e-9f18-d0b1d3e1ee63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:10.282256 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-826424ba-4160-4c0e-9f18-d0b1d3e1ee63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:10.515019 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-826424ba-4160-4c0e-9f18-d0b1d3e1ee63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:10.525963 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-826424ba-4160-4c0e-9f18-d0b1d3e1ee63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.259450 Aug 24 16:43:10.539969 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 235/466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:10 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:10.838672 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4bf163a1-9d2c-4a74-9d69-e226816bdd83 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:10.839225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4bf163a1-9d2c-4a74-9d69-e226816bdd83 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:10.846797 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bf163a1-9d2c-4a74-9d69-e226816bdd83 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:10.847288 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bf163a1-9d2c-4a74-9d69-e226816bdd83 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:10.847725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bf163a1-9d2c-4a74-9d69-e226816bdd83 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:10.848483 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bf163a1-9d2c-4a74-9d69-e226816bdd83 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:10.848938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bf163a1-9d2c-4a74-9d69-e226816bdd83 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:10.849363 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4bf163a1-9d2c-4a74-9d69-e226816bdd83 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:11.037358 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4bf163a1-9d2c-4a74-9d69-e226816bdd83 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:11.046928 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4bf163a1-9d2c-4a74-9d69-e226816bdd83 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.212153 Aug 24 16:43:11.047897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 232/467] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:10 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:11.063165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-ba7b1789-c8ee-4c2f-b3c4-e79b1c2fac9b req-a675d262-7973-4a67-bd52-6ec7ac70872d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e451e3e-9a42-40af-aff5-e8f8938252db", "tag": "bdb45216-e99f-41b9-b9d6-611a8882cee0"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:11.072460 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-ba7b1789-c8ee-4c2f-b3c4-e79b1c2fac9b req-a675d262-7973-4a67-bd52-6ec7ac70872d service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:11.072941 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-ba7b1789-c8ee-4c2f-b3c4-e79b1c2fac9b req-a675d262-7973-4a67-bd52-6ec7ac70872d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:11.073370 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-ba7b1789-c8ee-4c2f-b3c4-e79b1c2fac9b req-a675d262-7973-4a67-bd52-6ec7ac70872d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:11.084845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-ba7b1789-c8ee-4c2f-b3c4-e79b1c2fac9b req-a675d262-7973-4a67-bd52-6ec7ac70872d service nova] Creating event network-changed:bdb45216-e99f-41b9-b9d6-611a8882cee0 for instance 8e451e3e-9a42-40af-aff5-e8f8938252db on hv-cinder-77957 Aug 24 16:43:11.089833 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-ba7b1789-c8ee-4c2f-b3c4-e79b1c2fac9b req-a675d262-7973-4a67-bd52-6ec7ac70872d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036348 Aug 24 16:43:11.090356 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 236/468] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:11.549086 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-03e40ac9-7f36-4242-9a93-0096c2f8ab27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:11.550003 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-03e40ac9-7f36-4242-9a93-0096c2f8ab27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:11.556472 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03e40ac9-7f36-4242-9a93-0096c2f8ab27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:11.556964 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03e40ac9-7f36-4242-9a93-0096c2f8ab27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:11.557403 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03e40ac9-7f36-4242-9a93-0096c2f8ab27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:11.558111 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03e40ac9-7f36-4242-9a93-0096c2f8ab27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:11.558569 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03e40ac9-7f36-4242-9a93-0096c2f8ab27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:11.558995 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03e40ac9-7f36-4242-9a93-0096c2f8ab27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:11.703520 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-03e40ac9-7f36-4242-9a93-0096c2f8ab27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:11.711716 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-03e40ac9-7f36-4242-9a93-0096c2f8ab27 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.166462 Aug 24 16:43:11.712313 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 233/469] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:11 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:12.067660 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c183f6f3-6578-428e-9bbe-84174f7d21ab tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:12.068507 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c183f6f3-6578-428e-9bbe-84174f7d21ab tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:12.074776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c183f6f3-6578-428e-9bbe-84174f7d21ab tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:12.075342 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c183f6f3-6578-428e-9bbe-84174f7d21ab tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:12.076282 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c183f6f3-6578-428e-9bbe-84174f7d21ab tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:12.076816 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c183f6f3-6578-428e-9bbe-84174f7d21ab tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:12.077350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c183f6f3-6578-428e-9bbe-84174f7d21ab tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:12.077848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c183f6f3-6578-428e-9bbe-84174f7d21ab tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:12.225109 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c183f6f3-6578-428e-9bbe-84174f7d21ab tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:12.227647 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:12.234563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c183f6f3-6578-428e-9bbe-84174f7d21ab tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.171154 Aug 24 16:43:12.235128 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 237/470] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:12 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:12.733850 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8f4ad21b-de1a-4a64-9e1e-fc5bd0b5ca87 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:12.734462 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8f4ad21b-de1a-4a64-9e1e-fc5bd0b5ca87 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:12.737999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:12.738650 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=6 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:12.743192 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4ad21b-de1a-4a64-9e1e-fc5bd0b5ca87 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:12.743673 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4ad21b-de1a-4a64-9e1e-fc5bd0b5ca87 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:12.744133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4ad21b-de1a-4a64-9e1e-fc5bd0b5ca87 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:12.744829 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4ad21b-de1a-4a64-9e1e-fc5bd0b5ca87 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:12.745281 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4ad21b-de1a-4a64-9e1e-fc5bd0b5ca87 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:12.745704 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f4ad21b-de1a-4a64-9e1e-fc5bd0b5ca87 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:12.878582 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8f4ad21b-de1a-4a64-9e1e-fc5bd0b5ca87 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:12.886835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8f4ad21b-de1a-4a64-9e1e-fc5bd0b5ca87 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.157841 Aug 24 16:43:12.887401 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 234/471] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:12 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:13.254829 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1ba002ce-58bb-4d75-a765-9d00e6bdf507 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:13.255433 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1ba002ce-58bb-4d75-a765-9d00e6bdf507 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:13.257984 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:13.264180 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1ba002ce-58bb-4d75-a765-9d00e6bdf507 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:13.264669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1ba002ce-58bb-4d75-a765-9d00e6bdf507 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:13.265099 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1ba002ce-58bb-4d75-a765-9d00e6bdf507 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:13.265784 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1ba002ce-58bb-4d75-a765-9d00e6bdf507 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:13.266233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1ba002ce-58bb-4d75-a765-9d00e6bdf507 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:13.266649 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1ba002ce-58bb-4d75-a765-9d00e6bdf507 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:13.396695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1ba002ce-58bb-4d75-a765-9d00e6bdf507 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:13.405153 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1ba002ce-58bb-4d75-a765-9d00e6bdf507 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.154180 Aug 24 16:43:13.405721 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 238/472] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:13 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:13.908745 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b30ac77e-1c28-4e05-85ac-f317b7860fe8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:13.909350 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b30ac77e-1c28-4e05-85ac-f317b7860fe8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:13.915668 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b30ac77e-1c28-4e05-85ac-f317b7860fe8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:13.916178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b30ac77e-1c28-4e05-85ac-f317b7860fe8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:13.916607 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b30ac77e-1c28-4e05-85ac-f317b7860fe8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:13.917295 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b30ac77e-1c28-4e05-85ac-f317b7860fe8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:13.917745 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b30ac77e-1c28-4e05-85ac-f317b7860fe8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:13.918164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b30ac77e-1c28-4e05-85ac-f317b7860fe8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:14.051380 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b30ac77e-1c28-4e05-85ac-f317b7860fe8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:14.059516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b30ac77e-1c28-4e05-85ac-f317b7860fe8 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.154737 Aug 24 16:43:14.060663 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 235/473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:13 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:14.425699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-04b561b2-72fc-474d-89dc-04ca4d7c5c46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:14.426300 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-04b561b2-72fc-474d-89dc-04ca4d7c5c46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:14.432369 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04b561b2-72fc-474d-89dc-04ca4d7c5c46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:14.432858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04b561b2-72fc-474d-89dc-04ca4d7c5c46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:14.433294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04b561b2-72fc-474d-89dc-04ca4d7c5c46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:14.433990 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04b561b2-72fc-474d-89dc-04ca4d7c5c46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:14.434450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04b561b2-72fc-474d-89dc-04ca4d7c5c46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:14.434878 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04b561b2-72fc-474d-89dc-04ca4d7c5c46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:14.565898 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-04b561b2-72fc-474d-89dc-04ca4d7c5c46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:14.573787 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-04b561b2-72fc-474d-89dc-04ca4d7c5c46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.151955 Aug 24 16:43:14.574379 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 239/474] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:14 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:15.081380 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2064f9c4-4c09-4df9-a495-59271d36f433 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:15.081971 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2064f9c4-4c09-4df9-a495-59271d36f433 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:15.088864 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2064f9c4-4c09-4df9-a495-59271d36f433 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:15.089344 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2064f9c4-4c09-4df9-a495-59271d36f433 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:15.089770 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2064f9c4-4c09-4df9-a495-59271d36f433 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:15.091130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2064f9c4-4c09-4df9-a495-59271d36f433 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:15.091130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2064f9c4-4c09-4df9-a495-59271d36f433 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:15.091477 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2064f9c4-4c09-4df9-a495-59271d36f433 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:15.230164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2064f9c4-4c09-4df9-a495-59271d36f433 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:15.239219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2064f9c4-4c09-4df9-a495-59271d36f433 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.161817 Aug 24 16:43:15.239774 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 236/475] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:15 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:15.594991 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5822b274-d22c-4151-b0b4-14353d84e38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:15.595622 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5822b274-d22c-4151-b0b4-14353d84e38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:15.601625 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5822b274-d22c-4151-b0b4-14353d84e38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:15.602112 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5822b274-d22c-4151-b0b4-14353d84e38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:15.602549 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5822b274-d22c-4151-b0b4-14353d84e38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:15.603237 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5822b274-d22c-4151-b0b4-14353d84e38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:15.603693 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5822b274-d22c-4151-b0b4-14353d84e38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:15.604162 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5822b274-d22c-4151-b0b4-14353d84e38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:15.736704 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5822b274-d22c-4151-b0b4-14353d84e38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:15.744280 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5822b274-d22c-4151-b0b4-14353d84e38a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.153677 Aug 24 16:43:15.744850 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 240/476] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:15 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:16.260912 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-649e4c7e-0f3f-40b5-b3fc-8fe6e7e545dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:16.261529 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-649e4c7e-0f3f-40b5-b3fc-8fe6e7e545dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:16.268413 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-649e4c7e-0f3f-40b5-b3fc-8fe6e7e545dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:16.268903 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-649e4c7e-0f3f-40b5-b3fc-8fe6e7e545dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:16.269342 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-649e4c7e-0f3f-40b5-b3fc-8fe6e7e545dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:16.270035 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-649e4c7e-0f3f-40b5-b3fc-8fe6e7e545dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:16.270498 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-649e4c7e-0f3f-40b5-b3fc-8fe6e7e545dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:16.270924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-649e4c7e-0f3f-40b5-b3fc-8fe6e7e545dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:16.408485 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-649e4c7e-0f3f-40b5-b3fc-8fe6e7e545dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:16.416802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-649e4c7e-0f3f-40b5-b3fc-8fe6e7e545dd tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.159725 Aug 24 16:43:16.417369 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 237/477] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:16 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:16.765594 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6a61c31b-3fda-43a4-80d3-6cdbe801d1ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:16.766189 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6a61c31b-3fda-43a4-80d3-6cdbe801d1ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:16.772548 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a61c31b-3fda-43a4-80d3-6cdbe801d1ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:16.773271 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a61c31b-3fda-43a4-80d3-6cdbe801d1ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:16.773873 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a61c31b-3fda-43a4-80d3-6cdbe801d1ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:16.774913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a61c31b-3fda-43a4-80d3-6cdbe801d1ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:16.775366 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a61c31b-3fda-43a4-80d3-6cdbe801d1ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:16.775852 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6a61c31b-3fda-43a4-80d3-6cdbe801d1ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:16.924976 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6a61c31b-3fda-43a4-80d3-6cdbe801d1ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:16.933275 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6a61c31b-3fda-43a4-80d3-6cdbe801d1ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.172132 Aug 24 16:43:16.934142 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 241/478] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:16 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:17.438096 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f787147c-4b54-4d6f-b3a5-36d23c46ae7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:17.438706 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f787147c-4b54-4d6f-b3a5-36d23c46ae7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:17.445040 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f787147c-4b54-4d6f-b3a5-36d23c46ae7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:17.445525 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f787147c-4b54-4d6f-b3a5-36d23c46ae7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:17.445958 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f787147c-4b54-4d6f-b3a5-36d23c46ae7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:17.446649 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f787147c-4b54-4d6f-b3a5-36d23c46ae7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:17.447103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f787147c-4b54-4d6f-b3a5-36d23c46ae7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:17.447525 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f787147c-4b54-4d6f-b3a5-36d23c46ae7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:17.579867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f787147c-4b54-4d6f-b3a5-36d23c46ae7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:17.587988 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f787147c-4b54-4d6f-b3a5-36d23c46ae7a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.154313 Aug 24 16:43:17.588558 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 238/479] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:17 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:17.954839 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ba008dbe-c556-430e-83dc-163ff1811a05 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:17.955441 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ba008dbe-c556-430e-83dc-163ff1811a05 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:17.961331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ba008dbe-c556-430e-83dc-163ff1811a05 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:17.961823 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ba008dbe-c556-430e-83dc-163ff1811a05 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:17.962264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ba008dbe-c556-430e-83dc-163ff1811a05 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:17.962960 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ba008dbe-c556-430e-83dc-163ff1811a05 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:17.963416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ba008dbe-c556-430e-83dc-163ff1811a05 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:17.963843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ba008dbe-c556-430e-83dc-163ff1811a05 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:18.113855 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ba008dbe-c556-430e-83dc-163ff1811a05 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:18.121489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ba008dbe-c556-430e-83dc-163ff1811a05 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.171013 Aug 24 16:43:18.122070 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 242/480] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:17 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:18.610524 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-888cb4c5-5032-4a08-ad98-60869aefae02 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:18.611161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-888cb4c5-5032-4a08-ad98-60869aefae02 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:18.617459 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-888cb4c5-5032-4a08-ad98-60869aefae02 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:18.617964 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-888cb4c5-5032-4a08-ad98-60869aefae02 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:18.618388 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-888cb4c5-5032-4a08-ad98-60869aefae02 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:18.619072 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-888cb4c5-5032-4a08-ad98-60869aefae02 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:18.619516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-888cb4c5-5032-4a08-ad98-60869aefae02 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:18.619929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-888cb4c5-5032-4a08-ad98-60869aefae02 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:18.751800 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-888cb4c5-5032-4a08-ad98-60869aefae02 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:18.760267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-888cb4c5-5032-4a08-ad98-60869aefae02 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.154500 Aug 24 16:43:18.760858 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 239/481] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:18 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:19.144161 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e398b61c-33f3-4344-9042-ffefbc553a75 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:19.144771 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e398b61c-33f3-4344-9042-ffefbc553a75 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:19.151127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e398b61c-33f3-4344-9042-ffefbc553a75 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:19.151614 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e398b61c-33f3-4344-9042-ffefbc553a75 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:19.152067 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e398b61c-33f3-4344-9042-ffefbc553a75 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:19.152747 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e398b61c-33f3-4344-9042-ffefbc553a75 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:19.153193 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e398b61c-33f3-4344-9042-ffefbc553a75 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:19.154334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e398b61c-33f3-4344-9042-ffefbc553a75 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:19.290005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e398b61c-33f3-4344-9042-ffefbc553a75 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:19.299708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e398b61c-33f3-4344-9042-ffefbc553a75 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.160014 Aug 24 16:43:19.300313 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 243/482] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:19 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:19.782656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6e8d1c8f-29ad-44ae-a85f-97a5cc55278d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:19.783302 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6e8d1c8f-29ad-44ae-a85f-97a5cc55278d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:19.789818 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e8d1c8f-29ad-44ae-a85f-97a5cc55278d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:19.790300 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e8d1c8f-29ad-44ae-a85f-97a5cc55278d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:19.790736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e8d1c8f-29ad-44ae-a85f-97a5cc55278d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:19.791424 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e8d1c8f-29ad-44ae-a85f-97a5cc55278d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:19.791882 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e8d1c8f-29ad-44ae-a85f-97a5cc55278d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:19.792330 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e8d1c8f-29ad-44ae-a85f-97a5cc55278d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:19.920393 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6e8d1c8f-29ad-44ae-a85f-97a5cc55278d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:19.928677 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6e8d1c8f-29ad-44ae-a85f-97a5cc55278d tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.149824 Aug 24 16:43:19.929237 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 240/483] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:19 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:20.246535 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-c134be9e-5b03-4576-920d-4f1b8379ee18 req-bda5babd-b722-4e3f-ba2f-520026bab89a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ba5c9b-d3ec-4458-9ad3-eefdc9882599", "name": "network-vif-plugged", "status": "completed", "tag": "7e3be820-ac99-48f6-a3cd-ea4af916ff3b"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:20.256512 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c134be9e-5b03-4576-920d-4f1b8379ee18 req-bda5babd-b722-4e3f-ba2f-520026bab89a service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:20.256998 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c134be9e-5b03-4576-920d-4f1b8379ee18 req-bda5babd-b722-4e3f-ba2f-520026bab89a service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:20.257429 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c134be9e-5b03-4576-920d-4f1b8379ee18 req-bda5babd-b722-4e3f-ba2f-520026bab89a service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:20.269512 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-c134be9e-5b03-4576-920d-4f1b8379ee18 req-bda5babd-b722-4e3f-ba2f-520026bab89a service nova] Creating event network-vif-plugged:7e3be820-ac99-48f6-a3cd-ea4af916ff3b for instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 on hv-cinder-77957 Aug 24 16:43:20.274760 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-c134be9e-5b03-4576-920d-4f1b8379ee18 req-bda5babd-b722-4e3f-ba2f-520026bab89a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031594 Aug 24 16:43:20.275661 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 244/484] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:20.321274 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-5114eafa-3ba5-4fd7-abdf-2be75d4400f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:20.322057 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-5114eafa-3ba5-4fd7-abdf-2be75d4400f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:20.329925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5114eafa-3ba5-4fd7-abdf-2be75d4400f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:20.330479 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5114eafa-3ba5-4fd7-abdf-2be75d4400f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:20.330945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5114eafa-3ba5-4fd7-abdf-2be75d4400f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:20.331673 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5114eafa-3ba5-4fd7-abdf-2be75d4400f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:20.332224 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5114eafa-3ba5-4fd7-abdf-2be75d4400f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:20.332804 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5114eafa-3ba5-4fd7-abdf-2be75d4400f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:20.461345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5114eafa-3ba5-4fd7-abdf-2be75d4400f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:20.469920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-5114eafa-3ba5-4fd7-abdf-2be75d4400f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.153103 Aug 24 16:43:20.470467 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 241/485] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:20 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:20.951250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6825e590-e7c0-443b-a4c6-20d5a6d205c6 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:20.951956 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6825e590-e7c0-443b-a4c6-20d5a6d205c6 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:20.958153 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6825e590-e7c0-443b-a4c6-20d5a6d205c6 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:20.958591 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6825e590-e7c0-443b-a4c6-20d5a6d205c6 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:20.959037 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6825e590-e7c0-443b-a4c6-20d5a6d205c6 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:20.959723 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6825e590-e7c0-443b-a4c6-20d5a6d205c6 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:20.960221 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6825e590-e7c0-443b-a4c6-20d5a6d205c6 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:20.960648 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6825e590-e7c0-443b-a4c6-20d5a6d205c6 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:21.326067 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6825e590-e7c0-443b-a4c6-20d5a6d205c6 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:21.332513 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6825e590-e7c0-443b-a4c6-20d5a6d205c6 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.386077 Aug 24 16:43:21.333098 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 245/486] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:20 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:21.490892 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-baafa933-99a2-453e-a454-658e9571ad3f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:21.491534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-baafa933-99a2-453e-a454-658e9571ad3f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:21.498522 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baafa933-99a2-453e-a454-658e9571ad3f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:21.499010 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baafa933-99a2-453e-a454-658e9571ad3f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:21.499443 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baafa933-99a2-453e-a454-658e9571ad3f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:21.500269 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baafa933-99a2-453e-a454-658e9571ad3f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:21.500731 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baafa933-99a2-453e-a454-658e9571ad3f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:21.501157 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baafa933-99a2-453e-a454-658e9571ad3f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:21.634073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-baafa933-99a2-453e-a454-658e9571ad3f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:21.642323 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-baafa933-99a2-453e-a454-658e9571ad3f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.155578 Aug 24 16:43:21.642878 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 242/487] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:21 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:22.354161 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-824b9245-a215-48c4-a071-594fdd5bef73 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:22.354797 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-824b9245-a215-48c4-a071-594fdd5bef73 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:22.360816 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-824b9245-a215-48c4-a071-594fdd5bef73 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:22.361307 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-824b9245-a215-48c4-a071-594fdd5bef73 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:22.361746 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-824b9245-a215-48c4-a071-594fdd5bef73 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:22.362429 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-824b9245-a215-48c4-a071-594fdd5bef73 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:22.362882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-824b9245-a215-48c4-a071-594fdd5bef73 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:22.363304 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-824b9245-a215-48c4-a071-594fdd5bef73 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:22.491363 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-824b9245-a215-48c4-a071-594fdd5bef73 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:22.500504 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-824b9245-a215-48c4-a071-594fdd5bef73 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.150235 Aug 24 16:43:22.501073 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 246/488] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:22 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:22.664450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-585baddf-acca-41b4-bef9-2fe422e48d37 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:22.665056 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-585baddf-acca-41b4-bef9-2fe422e48d37 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:22.671748 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-585baddf-acca-41b4-bef9-2fe422e48d37 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:22.672261 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-585baddf-acca-41b4-bef9-2fe422e48d37 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:22.672692 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-585baddf-acca-41b4-bef9-2fe422e48d37 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:22.673373 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-585baddf-acca-41b4-bef9-2fe422e48d37 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:22.673826 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-585baddf-acca-41b4-bef9-2fe422e48d37 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:22.674243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-585baddf-acca-41b4-bef9-2fe422e48d37 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:22.802441 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-585baddf-acca-41b4-bef9-2fe422e48d37 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:22.809910 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-585baddf-acca-41b4-bef9-2fe422e48d37 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.149337 Aug 24 16:43:22.811104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 243/489] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:22 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:23.522666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-56d17b29-79f4-42f6-922e-0731cd55f1c2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:23.523277 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-56d17b29-79f4-42f6-922e-0731cd55f1c2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:23.529572 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56d17b29-79f4-42f6-922e-0731cd55f1c2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:23.530071 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56d17b29-79f4-42f6-922e-0731cd55f1c2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:23.530502 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56d17b29-79f4-42f6-922e-0731cd55f1c2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:23.531192 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56d17b29-79f4-42f6-922e-0731cd55f1c2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:23.531652 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56d17b29-79f4-42f6-922e-0731cd55f1c2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:23.532122 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56d17b29-79f4-42f6-922e-0731cd55f1c2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:23.660642 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-56d17b29-79f4-42f6-922e-0731cd55f1c2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:23.668718 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-56d17b29-79f4-42f6-922e-0731cd55f1c2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.149989 Aug 24 16:43:23.669285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 247/490] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:23 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:23.835752 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c22a91f1-1e97-443e-8e05-40256dff28bb tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:23.836395 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c22a91f1-1e97-443e-8e05-40256dff28bb tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:23.838627 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:23.844627 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c22a91f1-1e97-443e-8e05-40256dff28bb tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:23.845110 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c22a91f1-1e97-443e-8e05-40256dff28bb tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:23.845536 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c22a91f1-1e97-443e-8e05-40256dff28bb tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:23.846213 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c22a91f1-1e97-443e-8e05-40256dff28bb tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:23.846658 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c22a91f1-1e97-443e-8e05-40256dff28bb tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:23.847071 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c22a91f1-1e97-443e-8e05-40256dff28bb tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:23.977881 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c22a91f1-1e97-443e-8e05-40256dff28bb tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:23.985412 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c22a91f1-1e97-443e-8e05-40256dff28bb tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.153478 Aug 24 16:43:23.985972 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 244/491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:23 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:24.691039 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dfcf6a2e-c367-4653-8e25-a94d79b23b3b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:24.691644 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-dfcf6a2e-c367-4653-8e25-a94d79b23b3b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:24.697548 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfcf6a2e-c367-4653-8e25-a94d79b23b3b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:24.698029 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfcf6a2e-c367-4653-8e25-a94d79b23b3b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:24.698464 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfcf6a2e-c367-4653-8e25-a94d79b23b3b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:24.699143 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfcf6a2e-c367-4653-8e25-a94d79b23b3b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:24.699594 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfcf6a2e-c367-4653-8e25-a94d79b23b3b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:24.700037 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dfcf6a2e-c367-4653-8e25-a94d79b23b3b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:24.829014 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-dfcf6a2e-c367-4653-8e25-a94d79b23b3b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:24.837069 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-dfcf6a2e-c367-4653-8e25-a94d79b23b3b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.149867 Aug 24 16:43:24.837619 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 248/492] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:24 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:25.005160 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2ac20f5d-e478-413c-81fe-fecfc73485cc tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:25.005685 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2ac20f5d-e478-413c-81fe-fecfc73485cc tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:25.012082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac20f5d-e478-413c-81fe-fecfc73485cc tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:25.012568 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac20f5d-e478-413c-81fe-fecfc73485cc tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:25.013002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac20f5d-e478-413c-81fe-fecfc73485cc tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:25.014191 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac20f5d-e478-413c-81fe-fecfc73485cc tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:25.014780 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac20f5d-e478-413c-81fe-fecfc73485cc tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:25.015255 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2ac20f5d-e478-413c-81fe-fecfc73485cc tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:25.148867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2ac20f5d-e478-413c-81fe-fecfc73485cc tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:25.157467 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2ac20f5d-e478-413c-81fe-fecfc73485cc tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1266 microversion: 2.1 time: 0.156178 Aug 24 16:43:25.158017 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 245/493] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:25 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:25.858723 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-710ae71a-7c8f-41f0-9145-abad0c7bde24 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:25.859323 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-710ae71a-7c8f-41f0-9145-abad0c7bde24 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:25.865527 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-710ae71a-7c8f-41f0-9145-abad0c7bde24 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:25.865965 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-710ae71a-7c8f-41f0-9145-abad0c7bde24 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:25.866446 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-710ae71a-7c8f-41f0-9145-abad0c7bde24 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:25.867140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-710ae71a-7c8f-41f0-9145-abad0c7bde24 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:25.867596 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-710ae71a-7c8f-41f0-9145-abad0c7bde24 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:25.868065 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-710ae71a-7c8f-41f0-9145-abad0c7bde24 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:25.993578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-710ae71a-7c8f-41f0-9145-abad0c7bde24 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:26.002733 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-710ae71a-7c8f-41f0-9145-abad0c7bde24 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.148024 Aug 24 16:43:26.003510 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 249/494] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:25 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:26.178623 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b6549654-f7e6-4a54-b3a2-cc0b5e80c142 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:26.179164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b6549654-f7e6-4a54-b3a2-cc0b5e80c142 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:26.186141 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6549654-f7e6-4a54-b3a2-cc0b5e80c142 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:26.186902 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6549654-f7e6-4a54-b3a2-cc0b5e80c142 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:26.187147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6549654-f7e6-4a54-b3a2-cc0b5e80c142 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:26.187834 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6549654-f7e6-4a54-b3a2-cc0b5e80c142 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:26.188318 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6549654-f7e6-4a54-b3a2-cc0b5e80c142 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:26.188733 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b6549654-f7e6-4a54-b3a2-cc0b5e80c142 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:26.323807 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b6549654-f7e6-4a54-b3a2-cc0b5e80c142 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:26.335600 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b6549654-f7e6-4a54-b3a2-cc0b5e80c142 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1452 microversion: 2.1 time: 0.160803 Aug 24 16:43:26.336206 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 246/495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:26 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:26.357213 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6adb8bc2-2a5a-47da-8a29-095c106bb577 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:26.357836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6adb8bc2-2a5a-47da-8a29-095c106bb577 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:26.363660 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6adb8bc2-2a5a-47da-8a29-095c106bb577 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:26.364196 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6adb8bc2-2a5a-47da-8a29-095c106bb577 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:26.364635 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6adb8bc2-2a5a-47da-8a29-095c106bb577 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:26.365361 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6adb8bc2-2a5a-47da-8a29-095c106bb577 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:26.365820 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6adb8bc2-2a5a-47da-8a29-095c106bb577 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:26.366245 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6adb8bc2-2a5a-47da-8a29-095c106bb577 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:26.512608 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6adb8bc2-2a5a-47da-8a29-095c106bb577 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:26.521863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6adb8bc2-2a5a-47da-8a29-095c106bb577 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1452 microversion: 2.1 time: 0.168439 Aug 24 16:43:26.524101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 250/496] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:26 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:27.024127 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-49daaf5d-45da-46d2-95bf-0f093dc1dd8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:27.025123 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-49daaf5d-45da-46d2-95bf-0f093dc1dd8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:27.033135 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49daaf5d-45da-46d2-95bf-0f093dc1dd8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:27.035331 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49daaf5d-45da-46d2-95bf-0f093dc1dd8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:27.035792 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49daaf5d-45da-46d2-95bf-0f093dc1dd8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:27.036550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49daaf5d-45da-46d2-95bf-0f093dc1dd8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:27.037012 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49daaf5d-45da-46d2-95bf-0f093dc1dd8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:27.037434 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49daaf5d-45da-46d2-95bf-0f093dc1dd8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:27.266407 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-49daaf5d-45da-46d2-95bf-0f093dc1dd8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:27.274736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-49daaf5d-45da-46d2-95bf-0f093dc1dd8c tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.254349 Aug 24 16:43:27.275302 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 247/497] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:27 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:28.231498 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-4e549edb-4264-4934-ba96-87224a914b35 req-5593d293-3824-4ff1-a096-1ad40b72bb07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ba5c9b-d3ec-4458-9ad3-eefdc9882599", "tag": "7e3be820-ac99-48f6-a3cd-ea4af916ff3b"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:28.237142 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=62 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:28.242845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-4e549edb-4264-4934-ba96-87224a914b35 req-5593d293-3824-4ff1-a096-1ad40b72bb07 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:28.243318 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-4e549edb-4264-4934-ba96-87224a914b35 req-5593d293-3824-4ff1-a096-1ad40b72bb07 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:28.243737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-4e549edb-4264-4934-ba96-87224a914b35 req-5593d293-3824-4ff1-a096-1ad40b72bb07 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:28.255021 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-4e549edb-4264-4934-ba96-87224a914b35 req-5593d293-3824-4ff1-a096-1ad40b72bb07 service nova] Creating event network-changed:7e3be820-ac99-48f6-a3cd-ea4af916ff3b for instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 on hv-cinder-77957 Aug 24 16:43:28.260046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-4e549edb-4264-4934-ba96-87224a914b35 req-5593d293-3824-4ff1-a096-1ad40b72bb07 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032125 Aug 24 16:43:28.260630 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 251/498] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:28.297144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1fe4a105-8e8f-4b0f-8701-83da66cbc75a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:28.297837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1fe4a105-8e8f-4b0f-8701-83da66cbc75a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:28.304283 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a105-8e8f-4b0f-8701-83da66cbc75a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:28.304861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a105-8e8f-4b0f-8701-83da66cbc75a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:28.305366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a105-8e8f-4b0f-8701-83da66cbc75a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:28.306128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a105-8e8f-4b0f-8701-83da66cbc75a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:28.306656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a105-8e8f-4b0f-8701-83da66cbc75a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:28.307147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a105-8e8f-4b0f-8701-83da66cbc75a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:28.322225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=100 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:28.442608 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1fe4a105-8e8f-4b0f-8701-83da66cbc75a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:28.451799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1fe4a105-8e8f-4b0f-8701-83da66cbc75a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.158454 Aug 24 16:43:28.452449 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 248/499] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:28 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:29.474376 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0c1d6787-ebfc-47ac-bd4c-ee3f2987c885 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:29.475067 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0c1d6787-ebfc-47ac-bd4c-ee3f2987c885 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:29.481226 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c1d6787-ebfc-47ac-bd4c-ee3f2987c885 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:29.481710 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c1d6787-ebfc-47ac-bd4c-ee3f2987c885 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:29.482148 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c1d6787-ebfc-47ac-bd4c-ee3f2987c885 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:29.483315 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c1d6787-ebfc-47ac-bd4c-ee3f2987c885 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:29.483772 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c1d6787-ebfc-47ac-bd4c-ee3f2987c885 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:29.484228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c1d6787-ebfc-47ac-bd4c-ee3f2987c885 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:29.617148 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0c1d6787-ebfc-47ac-bd4c-ee3f2987c885 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:29.626374 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0c1d6787-ebfc-47ac-bd4c-ee3f2987c885 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.156237 Aug 24 16:43:29.626937 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 252/500] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:29 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:30.648353 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8661f20a-f909-463d-970b-9c83f1b8da60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:30.648961 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8661f20a-f909-463d-970b-9c83f1b8da60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:30.656137 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8661f20a-f909-463d-970b-9c83f1b8da60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:30.656620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8661f20a-f909-463d-970b-9c83f1b8da60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:30.657053 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8661f20a-f909-463d-970b-9c83f1b8da60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:30.657738 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8661f20a-f909-463d-970b-9c83f1b8da60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:30.658194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8661f20a-f909-463d-970b-9c83f1b8da60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:30.658616 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8661f20a-f909-463d-970b-9c83f1b8da60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:30.789268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8661f20a-f909-463d-970b-9c83f1b8da60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:30.798209 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8661f20a-f909-463d-970b-9c83f1b8da60 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.153593 Aug 24 16:43:30.799020 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 249/501] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:30 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:31.820348 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-aabb622b-a7c0-45dc-9fc4-432352b0a674 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:31.820961 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-aabb622b-a7c0-45dc-9fc4-432352b0a674 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:31.826883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aabb622b-a7c0-45dc-9fc4-432352b0a674 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:31.827523 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aabb622b-a7c0-45dc-9fc4-432352b0a674 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:31.827985 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aabb622b-a7c0-45dc-9fc4-432352b0a674 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:31.828680 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aabb622b-a7c0-45dc-9fc4-432352b0a674 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:31.829143 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aabb622b-a7c0-45dc-9fc4-432352b0a674 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:31.829569 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aabb622b-a7c0-45dc-9fc4-432352b0a674 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:31.963085 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-aabb622b-a7c0-45dc-9fc4-432352b0a674 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:31.972663 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-aabb622b-a7c0-45dc-9fc4-432352b0a674 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.156204 Aug 24 16:43:31.973228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 253/502] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:31 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:32.994966 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-95aaeec8-72f0-43f3-9e9d-76f26fee296b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:32.995575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-95aaeec8-72f0-43f3-9e9d-76f26fee296b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:33.003219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-95aaeec8-72f0-43f3-9e9d-76f26fee296b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:33.003805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-95aaeec8-72f0-43f3-9e9d-76f26fee296b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:33.004252 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-95aaeec8-72f0-43f3-9e9d-76f26fee296b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:33.005048 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-95aaeec8-72f0-43f3-9e9d-76f26fee296b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:33.005545 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-95aaeec8-72f0-43f3-9e9d-76f26fee296b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:33.005976 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-95aaeec8-72f0-43f3-9e9d-76f26fee296b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:33.137835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-95aaeec8-72f0-43f3-9e9d-76f26fee296b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:33.147066 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-95aaeec8-72f0-43f3-9e9d-76f26fee296b tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1733 microversion: 2.1 time: 0.155917 Aug 24 16:43:33.147639 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 250/503] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:32 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:34.082889 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d7efaccb-f0d3-44ac-a61d-0ad3a7cbf6b7 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:34.083401 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d7efaccb-f0d3-44ac-a61d-0ad3a7cbf6b7 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:34.089878 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7efaccb-f0d3-44ac-a61d-0ad3a7cbf6b7 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:34.090586 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7efaccb-f0d3-44ac-a61d-0ad3a7cbf6b7 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:34.091222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7efaccb-f0d3-44ac-a61d-0ad3a7cbf6b7 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:34.091999 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7efaccb-f0d3-44ac-a61d-0ad3a7cbf6b7 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:34.092402 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7efaccb-f0d3-44ac-a61d-0ad3a7cbf6b7 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:34.092828 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d7efaccb-f0d3-44ac-a61d-0ad3a7cbf6b7 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:34.169202 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c480ba2f-1a05-4783-a06f-3b2b0bc33cca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:34.169815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c480ba2f-1a05-4783-a06f-3b2b0bc33cca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:34.182532 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c480ba2f-1a05-4783-a06f-3b2b0bc33cca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:34.183122 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c480ba2f-1a05-4783-a06f-3b2b0bc33cca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:34.183561 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c480ba2f-1a05-4783-a06f-3b2b0bc33cca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:34.184319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c480ba2f-1a05-4783-a06f-3b2b0bc33cca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:34.184776 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c480ba2f-1a05-4783-a06f-3b2b0bc33cca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:34.185200 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c480ba2f-1a05-4783-a06f-3b2b0bc33cca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:34.245600 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-d7efaccb-f0d3-44ac-a61d-0ad3a7cbf6b7 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lazy-loading 'services' on Instance uuid 80dedc7b-6a52-4870-9cf1-c4955c34e813 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:43:34.345054 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c480ba2f-1a05-4783-a06f-3b2b0bc33cca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:34.353861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c480ba2f-1a05-4783-a06f-3b2b0bc33cca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1713 microversion: 2.1 time: 0.188379 Aug 24 16:43:34.354452 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 251/504] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:34 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1713 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:34.361149 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d7efaccb-f0d3-44ac-a61d-0ad3a7cbf6b7 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "DELETE /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813/os-volume_attachments/f3385c99-9382-4398-ac33-029a86445f32" status: 202 len: 0 microversion: 2.1 time: 0.282044 Aug 24 16:43:34.361727 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 254/505] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:43:34 2022] DELETE /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813/os-volume_attachments/f3385c99-9382-4398-ac33-029a86445f32 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:43:34.464037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:34.464538 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:34.470516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:34.470997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:34.471435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:34.472157 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:34.472614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:34.473035 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:34.596797 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] HTTP exception thrown: Cannot 'detach_volume' instance f0aa7b07-8c79-4568-af26-cc2273f85a11 while it is in vm_state rescued Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Request method failure captured: Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: DELETE /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments/242b3fc2-0394-4aee-9406-d2d23c5d8c5f HTTP/1.1 Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlRBhQR1lbs4RdUK-GiSPx-LtPDp2QiIndw-478r2tK5_Xz7olHCVUXWZVJ9gIW6gNDIzpDQZy_qXn2yPdlWeDbyTIMUIxN33m1zYrBlzuNeO2TFzdPUg9oQdxR4xHHbb6xtGJVMQSJxFDwQl1Z_U_5Iw3ml3O21qf7Ig12FpMTmpP0 Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 364a00263e804efe83ae759d9c4c01fb Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:43:34.598465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_364a00263e804efe83ae759d9c4c01fb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 364a00263e804efe83ae759d9c4c01fb Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-ServerRescueNegativeTestJSON-606785984-project Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: fded55a41aae41c6af61382a7c35372e Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606785984-project Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:43:34.600095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Cannot 'detach_volume' instance f0aa7b07-8c79-4568-af26-cc2273f85a11 while it is in vm_state rescued Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'server_id': 'f0aa7b07-8c79-4568-af26-cc2273f85a11', 'id': '242b3fc2-0394-4aee-9406-d2d23c5d8c5f'} Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f0aa7b07-8c79-4568-af26-cc2273f85a11 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:43:34.600802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f0aa7b07-8c79-4568-af26-cc2273f85a11 while it is in vm_state rescued Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f0aa7b07-8c79-4568-af26-cc2273f85a11 while it is in vm_state rescued Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:34.602073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Returning 409 to user: Cannot 'detach_volume' instance f0aa7b07-8c79-4568-af26-cc2273f85a11 while it is in vm_state rescued {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:43:34.603071 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-25a803d7-3464-44d8-b8d1-404b0d308d0a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments/242b3fc2-0394-4aee-9406-d2d23c5d8c5f" status: 409 len: 152 microversion: 2.1 time: 0.139851 Aug 24 16:43:34.603071 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 252/506] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:43:34 2022] DELETE /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments/242b3fc2-0394-4aee-9406-d2d23c5d8c5f => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 16:43:34.610415 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e8b7e4be-955a-48bb-bdab-c45e0055985a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:34.611023 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e8b7e4be-955a-48bb-bdab-c45e0055985a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:34.617371 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8b7e4be-955a-48bb-bdab-c45e0055985a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:34.617852 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8b7e4be-955a-48bb-bdab-c45e0055985a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:34.618291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8b7e4be-955a-48bb-bdab-c45e0055985a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:34.618987 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8b7e4be-955a-48bb-bdab-c45e0055985a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:34.619437 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8b7e4be-955a-48bb-bdab-c45e0055985a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:34.619861 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8b7e4be-955a-48bb-bdab-c45e0055985a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:34.622344 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:34.688280 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e8b7e4be-955a-48bb-bdab-c45e0055985a tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "POST /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/action" status: 202 len: 0 microversion: 2.1 time: 0.082385 Aug 24 16:43:34.692093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 255/507] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:43:34 2022] POST /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:43:34.697131 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-fcb765df-36a0-4840-b147-3af394865f19 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:34.697741 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-fcb765df-36a0-4840-b147-3af394865f19 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:34.705891 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fcb765df-36a0-4840-b147-3af394865f19 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:34.706389 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fcb765df-36a0-4840-b147-3af394865f19 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:34.706825 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fcb765df-36a0-4840-b147-3af394865f19 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:34.707552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fcb765df-36a0-4840-b147-3af394865f19 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:34.708040 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fcb765df-36a0-4840-b147-3af394865f19 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:34.708473 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fcb765df-36a0-4840-b147-3af394865f19 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:34.848417 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-fcb765df-36a0-4840-b147-3af394865f19 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:34.856585 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-fcb765df-36a0-4840-b147-3af394865f19 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1721 microversion: 2.1 time: 0.163378 Aug 24 16:43:34.857162 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 253/508] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:34 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:35.879464 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f4a83ee2-fea7-4eb1-87d5-1be2f2d02ed4 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:35.880192 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f4a83ee2-fea7-4eb1-87d5-1be2f2d02ed4 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:35.886592 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4a83ee2-fea7-4eb1-87d5-1be2f2d02ed4 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:35.887110 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4a83ee2-fea7-4eb1-87d5-1be2f2d02ed4 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:35.887547 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4a83ee2-fea7-4eb1-87d5-1be2f2d02ed4 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:35.888356 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4a83ee2-fea7-4eb1-87d5-1be2f2d02ed4 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:35.888813 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4a83ee2-fea7-4eb1-87d5-1be2f2d02ed4 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:35.889233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4a83ee2-fea7-4eb1-87d5-1be2f2d02ed4 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:36.052038 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f4a83ee2-fea7-4eb1-87d5-1be2f2d02ed4 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:36.060493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f4a83ee2-fea7-4eb1-87d5-1be2f2d02ed4 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1721 microversion: 2.1 time: 0.186155 Aug 24 16:43:36.061078 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 256/509] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:35 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:36.565037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a1dc0c22-9c55-4123-8879-68b46308c59a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:36.565562 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a1dc0c22-9c55-4123-8879-68b46308c59a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:36.572045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a1dc0c22-9c55-4123-8879-68b46308c59a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:36.572528 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a1dc0c22-9c55-4123-8879-68b46308c59a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:36.572969 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a1dc0c22-9c55-4123-8879-68b46308c59a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:36.573656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a1dc0c22-9c55-4123-8879-68b46308c59a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:36.574112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a1dc0c22-9c55-4123-8879-68b46308c59a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:36.574534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a1dc0c22-9c55-4123-8879-68b46308c59a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:36.604397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a1dc0c22-9c55-4123-8879-68b46308c59a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:43:36.677509 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a1dc0c22-9c55-4123-8879-68b46308c59a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "DELETE /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 204 len: 0 microversion: 2.1 time: 0.116278 Aug 24 16:43:36.678080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 254/510] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:43:36 2022] DELETE /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:43:36.687149 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-af0fdc8f-de01-4b96-8d49-245cde7b3b81 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:36.687788 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-af0fdc8f-de01-4b96-8d49-245cde7b3b81 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:36.693868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-af0fdc8f-de01-4b96-8d49-245cde7b3b81 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:36.694354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-af0fdc8f-de01-4b96-8d49-245cde7b3b81 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:36.694790 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-af0fdc8f-de01-4b96-8d49-245cde7b3b81 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:36.695478 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-af0fdc8f-de01-4b96-8d49-245cde7b3b81 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:36.695937 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-af0fdc8f-de01-4b96-8d49-245cde7b3b81 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:36.696408 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-af0fdc8f-de01-4b96-8d49-245cde7b3b81 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:36.833114 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-af0fdc8f-de01-4b96-8d49-245cde7b3b81 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:36.840716 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-af0fdc8f-de01-4b96-8d49-245cde7b3b81 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1514 microversion: 2.1 time: 0.158391 Aug 24 16:43:36.841282 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 257/511] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:36 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:37.082678 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9a032518-378b-47a8-8944-4d769c6932de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:37.083368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9a032518-378b-47a8-8944-4d769c6932de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:37.089323 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9a032518-378b-47a8-8944-4d769c6932de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:37.089807 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9a032518-378b-47a8-8944-4d769c6932de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:37.090244 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9a032518-378b-47a8-8944-4d769c6932de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:37.090935 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9a032518-378b-47a8-8944-4d769c6932de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:37.091393 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9a032518-378b-47a8-8944-4d769c6932de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:37.091818 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9a032518-378b-47a8-8944-4d769c6932de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:37.221804 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9a032518-378b-47a8-8944-4d769c6932de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:37.230017 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9a032518-378b-47a8-8944-4d769c6932de tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1721 microversion: 2.1 time: 0.151601 Aug 24 16:43:37.230581 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 255/512] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:37 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:37.861254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-752e4364-b19d-434a-a058-a09a766cd25b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:37.862011 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-752e4364-b19d-434a-a058-a09a766cd25b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:37.868070 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-752e4364-b19d-434a-a058-a09a766cd25b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:37.868551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-752e4364-b19d-434a-a058-a09a766cd25b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:37.868977 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-752e4364-b19d-434a-a058-a09a766cd25b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:37.869653 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-752e4364-b19d-434a-a058-a09a766cd25b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:37.870099 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-752e4364-b19d-434a-a058-a09a766cd25b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:37.870512 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-752e4364-b19d-434a-a058-a09a766cd25b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:38.003048 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-752e4364-b19d-434a-a058-a09a766cd25b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:38.010733 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-752e4364-b19d-434a-a058-a09a766cd25b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1514 microversion: 2.1 time: 0.153358 Aug 24 16:43:38.011285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 258/513] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:37 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:38.252321 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4dcb6bb0-a757-4742-b617-09643e7d5dca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:38.252932 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4dcb6bb0-a757-4742-b617-09643e7d5dca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:38.259384 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4dcb6bb0-a757-4742-b617-09643e7d5dca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:38.259867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4dcb6bb0-a757-4742-b617-09643e7d5dca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:38.260336 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4dcb6bb0-a757-4742-b617-09643e7d5dca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:38.261021 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4dcb6bb0-a757-4742-b617-09643e7d5dca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:38.261473 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4dcb6bb0-a757-4742-b617-09643e7d5dca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:38.261896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4dcb6bb0-a757-4742-b617-09643e7d5dca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:38.394710 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4dcb6bb0-a757-4742-b617-09643e7d5dca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:38.403179 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4dcb6bb0-a757-4742-b617-09643e7d5dca tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1721 microversion: 2.1 time: 0.155334 Aug 24 16:43:38.403740 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 256/514] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:38 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:39.033631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a9250657-a344-45a6-91af-bfcc4b00fe1c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:39.034195 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a9250657-a344-45a6-91af-bfcc4b00fe1c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:39.040341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a9250657-a344-45a6-91af-bfcc4b00fe1c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:39.040820 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a9250657-a344-45a6-91af-bfcc4b00fe1c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:39.041325 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a9250657-a344-45a6-91af-bfcc4b00fe1c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:39.042168 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a9250657-a344-45a6-91af-bfcc4b00fe1c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:39.042661 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a9250657-a344-45a6-91af-bfcc4b00fe1c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:39.043339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a9250657-a344-45a6-91af-bfcc4b00fe1c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:39.171413 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a9250657-a344-45a6-91af-bfcc4b00fe1c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:39.178988 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a9250657-a344-45a6-91af-bfcc4b00fe1c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1514 microversion: 2.1 time: 0.149760 Aug 24 16:43:39.179548 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 259/515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:39 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:39.424881 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4473700c-84e9-4808-8ecb-e8d1e1142dd2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:39.425472 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4473700c-84e9-4808-8ecb-e8d1e1142dd2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:39.431692 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4473700c-84e9-4808-8ecb-e8d1e1142dd2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:39.432414 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4473700c-84e9-4808-8ecb-e8d1e1142dd2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:39.433124 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4473700c-84e9-4808-8ecb-e8d1e1142dd2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:39.434175 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4473700c-84e9-4808-8ecb-e8d1e1142dd2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:39.434971 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4473700c-84e9-4808-8ecb-e8d1e1142dd2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:39.435417 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4473700c-84e9-4808-8ecb-e8d1e1142dd2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:39.568905 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4473700c-84e9-4808-8ecb-e8d1e1142dd2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:39.576876 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4473700c-84e9-4808-8ecb-e8d1e1142dd2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1727 microversion: 2.1 time: 0.156254 Aug 24 16:43:39.577929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 257/516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:39 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:39.598072 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3d4987a4-e9ef-4c49-ad92-f9610b0b70aa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:39.598566 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3d4987a4-e9ef-4c49-ad92-f9610b0b70aa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:39.604387 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d4987a4-e9ef-4c49-ad92-f9610b0b70aa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:39.604871 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d4987a4-e9ef-4c49-ad92-f9610b0b70aa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:39.605302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d4987a4-e9ef-4c49-ad92-f9610b0b70aa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:39.605988 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d4987a4-e9ef-4c49-ad92-f9610b0b70aa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:39.606440 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d4987a4-e9ef-4c49-ad92-f9610b0b70aa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:39.606860 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d4987a4-e9ef-4c49-ad92-f9610b0b70aa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:39.683098 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3d4987a4-e9ef-4c49-ad92-f9610b0b70aa tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088732 Aug 24 16:43:39.683691 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 260/517] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 16:43:39 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:40.201256 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0de9b321-0edf-4713-a76d-66b2fe03b877 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:40.201933 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0de9b321-0edf-4713-a76d-66b2fe03b877 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:40.208483 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0de9b321-0edf-4713-a76d-66b2fe03b877 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:40.208970 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0de9b321-0edf-4713-a76d-66b2fe03b877 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:40.209557 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0de9b321-0edf-4713-a76d-66b2fe03b877 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:40.210343 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0de9b321-0edf-4713-a76d-66b2fe03b877 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:40.210894 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0de9b321-0edf-4713-a76d-66b2fe03b877 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:40.211296 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0de9b321-0edf-4713-a76d-66b2fe03b877 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:40.644719 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-0bcc880a-7e8a-4268-bdba-e7992c56caf4 req-54ac9183-3fbd-4fd9-b9a6-d8360da3fa54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80dedc7b-6a52-4870-9cf1-c4955c34e813", "name": "network-vif-deleted", "tag": "b4171e1e-f4fd-4747-b163-30dfd39d308d"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:40.663105 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-0bcc880a-7e8a-4268-bdba-e7992c56caf4 req-54ac9183-3fbd-4fd9-b9a6-d8360da3fa54 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:40.663688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-0bcc880a-7e8a-4268-bdba-e7992c56caf4 req-54ac9183-3fbd-4fd9-b9a6-d8360da3fa54 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:40.664208 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-0bcc880a-7e8a-4268-bdba-e7992c56caf4 req-54ac9183-3fbd-4fd9-b9a6-d8360da3fa54 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:40.679134 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-0de9b321-0edf-4713-a76d-66b2fe03b877 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:40.679684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-0bcc880a-7e8a-4268-bdba-e7992c56caf4 req-54ac9183-3fbd-4fd9-b9a6-d8360da3fa54 service nova] Creating event network-vif-deleted:b4171e1e-f4fd-4747-b163-30dfd39d308d for instance 80dedc7b-6a52-4870-9cf1-c4955c34e813 on hv-cinder-77957 Aug 24 16:43:40.685728 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-0bcc880a-7e8a-4268-bdba-e7992c56caf4 req-54ac9183-3fbd-4fd9-b9a6-d8360da3fa54 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044777 Aug 24 16:43:40.687750 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 261/518] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:40.689280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0de9b321-0edf-4713-a76d-66b2fe03b877 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 200 len: 1514 microversion: 2.1 time: 0.491956 Aug 24 16:43:40.699384 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 258/519] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:40 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 1514 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:40.881787 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-11cc2a5c-a997-420e-bc3c-2b0dbacaf604 req-88fae1b4-07e1-4d4f-8215-9424d5d60106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0aa7b07-8c79-4568-af26-cc2273f85a11", "tag": "059a432e-b0cb-433f-af23-9677d8b9ba22"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:40.892221 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-11cc2a5c-a997-420e-bc3c-2b0dbacaf604 req-88fae1b4-07e1-4d4f-8215-9424d5d60106 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:40.892826 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-11cc2a5c-a997-420e-bc3c-2b0dbacaf604 req-88fae1b4-07e1-4d4f-8215-9424d5d60106 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:40.893518 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-11cc2a5c-a997-420e-bc3c-2b0dbacaf604 req-88fae1b4-07e1-4d4f-8215-9424d5d60106 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:40.904818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-11cc2a5c-a997-420e-bc3c-2b0dbacaf604 req-88fae1b4-07e1-4d4f-8215-9424d5d60106 service nova] Creating event network-changed:059a432e-b0cb-433f-af23-9677d8b9ba22 for instance f0aa7b07-8c79-4568-af26-cc2273f85a11 on hv-cinder-77957 Aug 24 16:43:40.913794 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-11cc2a5c-a997-420e-bc3c-2b0dbacaf604 req-88fae1b4-07e1-4d4f-8215-9424d5d60106 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032749 Aug 24 16:43:40.914422 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 262/520] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:43:41.721661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:41.722272 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: 80dedc7b-6a52-4870-9cf1-c4955c34e813] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:41.728804 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:41.730933 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:41.731415 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:41.732366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:41.732842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:41.733271 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:41.747515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] HTTP exception thrown: Instance 80dedc7b-6a52-4870-9cf1-c4955c34e813 could not be found. Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Request method failure captured: Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 HTTP/1.1 Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlT4tUzMeIHeDTbNpRszDAF8GoEsKFY7nLyjv6msgXmqb3nPxp-TkrVSJumtJ46xcLdrUCiYG7b73mF48w97YWwCpderde1VMxUEt5HtiELO3DZGCYu48iTIQr-V0eca9IIr7j5aNaWW2JlhqZnEIm50opoPnkwm9I9tJQz2MwX-4ks Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 099d0dfa51be462e9650ab8ce50465fb Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1341701760 Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:43:41.749194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/099d0dfa51be462e9650ab8ce50465fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/099d0dfa51be462e9650ab8ce50465fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/099d0dfa51be462e9650ab8ce50465fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_099d0dfa51be462e9650ab8ce50465fb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-VolumesSnapshotTestJSON-1341701760 Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 099d0dfa51be462e9650ab8ce50465fb Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1341701760 Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-VolumesSnapshotTestJSON-1341701760-project Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: ad81d5c075d64fa8978122e124d00e19 Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-VolumesSnapshotTestJSON-1341701760-project Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 80dedc7b-6a52-4870-9cf1-c4955c34e813 could not be found. Aug 24 16:43:41.750799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '80dedc7b-6a52-4870-9cf1-c4955c34e813'} Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80dedc7b-6a52-4870-9cf1-c4955c34e813 could not be found. Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:43:41.751662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80dedc7b-6a52-4870-9cf1-c4955c34e813 could not be found. Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80dedc7b-6a52-4870-9cf1-c4955c34e813 could not be found. Aug 24 16:43:41.752915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:41.754528 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Returning 404 to user: Instance 80dedc7b-6a52-4870-9cf1-c4955c34e813 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:43:41.754528 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-34183873-0bf9-4866-a653-26a9529a3593 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813" status: 404 len: 111 microversion: 2.1 time: 0.034027 Aug 24 16:43:41.754528 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 259/521] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:41 2022] GET /compute/v2.1/servers/80dedc7b-6a52-4870-9cf1-c4955c34e813 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:43:42.928933 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-fd0fa8ba-01d0-46b3-b6ac-75cbf2ca52e0 req-67a3b5d0-be5a-4c1a-950a-788b4f136780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0aa7b07-8c79-4568-af26-cc2273f85a11", "tag": "059a432e-b0cb-433f-af23-9677d8b9ba22"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:42.939106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-fd0fa8ba-01d0-46b3-b6ac-75cbf2ca52e0 req-67a3b5d0-be5a-4c1a-950a-788b4f136780 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:42.939595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-fd0fa8ba-01d0-46b3-b6ac-75cbf2ca52e0 req-67a3b5d0-be5a-4c1a-950a-788b4f136780 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:42.940046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-fd0fa8ba-01d0-46b3-b6ac-75cbf2ca52e0 req-67a3b5d0-be5a-4c1a-950a-788b4f136780 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:42.951023 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-fd0fa8ba-01d0-46b3-b6ac-75cbf2ca52e0 req-67a3b5d0-be5a-4c1a-950a-788b4f136780 service nova] Creating event network-changed:059a432e-b0cb-433f-af23-9677d8b9ba22 for instance f0aa7b07-8c79-4568-af26-cc2273f85a11 on hv-cinder-77957 Aug 24 16:43:42.956864 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-fd0fa8ba-01d0-46b3-b6ac-75cbf2ca52e0 req-67a3b5d0-be5a-4c1a-950a-788b4f136780 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031894 Aug 24 16:43:42.957462 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 263/522] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:49.365295 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-39b014d9-a98f-47e1-acc3-db330e47eefa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:49.365856 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-39b014d9-a98f-47e1-acc3-db330e47eefa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:49.372042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39b014d9-a98f-47e1-acc3-db330e47eefa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:49.372530 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39b014d9-a98f-47e1-acc3-db330e47eefa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:49.372968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39b014d9-a98f-47e1-acc3-db330e47eefa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:49.373658 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39b014d9-a98f-47e1-acc3-db330e47eefa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:49.374119 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39b014d9-a98f-47e1-acc3-db330e47eefa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:49.374548 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39b014d9-a98f-47e1-acc3-db330e47eefa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:49.407441 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-39b014d9-a98f-47e1-acc3-db330e47eefa tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-volume_attachments/468bf54e-d173-43cb-a390-646cf393a169" status: 200 len: 194 microversion: 2.20 time: 0.046109 Aug 24 16:43:49.408031 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 260/523] 10.222.0.52 () {60 vars in 1454 bytes} [Wed Aug 24 16:43:49 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-volume_attachments/468bf54e-d173-43cb-a390-646cf393a169 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:43:49.475822 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-60ec7234-2c40-4f13-891c-ea37ccb36f11 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:49.476598 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-60ec7234-2c40-4f13-891c-ea37ccb36f11 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:49.482739 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60ec7234-2c40-4f13-891c-ea37ccb36f11 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:49.483216 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60ec7234-2c40-4f13-891c-ea37ccb36f11 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:49.483643 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60ec7234-2c40-4f13-891c-ea37ccb36f11 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:49.484383 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60ec7234-2c40-4f13-891c-ea37ccb36f11 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:49.485028 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60ec7234-2c40-4f13-891c-ea37ccb36f11 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:49.485541 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60ec7234-2c40-4f13-891c-ea37ccb36f11 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:49.544797 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1910542787", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "networks": [{"uuid": "785419d7-4660-46de-9f6b-0e7db4d1bf1a"}]}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:49.569823 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-60ec7234-2c40-4f13-891c-ea37ccb36f11 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lazy-loading 'services' on Instance uuid 66f46124-a6dc-4300-88a6-3143240719da {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:43:49.599161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] validate_networks() for [('785419d7-4660-46de-9f6b-0e7db4d1bf1a', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:43:49.642839 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-60ec7234-2c40-4f13-891c-ea37ccb36f11 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-volume_attachments/468bf54e-d173-43cb-a390-646cf393a169" status: 202 len: 0 microversion: 2.20 time: 0.171465 Aug 24 16:43:49.643845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 264/524] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Aug 24 16:43:49 2022] DELETE /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-volume_attachments/468bf54e-d173-43cb-a390-646cf393a169 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:43:49.654451 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a6ed9bc8-2a17-4a7e-a780-7559a0a298f8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:49.656849 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a6ed9bc8-2a17-4a7e-a780-7559a0a298f8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:49.663136 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6ed9bc8-2a17-4a7e-a780-7559a0a298f8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:49.663619 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6ed9bc8-2a17-4a7e-a780-7559a0a298f8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:49.664146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6ed9bc8-2a17-4a7e-a780-7559a0a298f8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:49.664921 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6ed9bc8-2a17-4a7e-a780-7559a0a298f8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:49.665419 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6ed9bc8-2a17-4a7e-a780-7559a0a298f8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:49.665919 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a6ed9bc8-2a17-4a7e-a780-7559a0a298f8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:49.700362 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a6ed9bc8-2a17-4a7e-a780-7559a0a298f8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050776 Aug 24 16:43:49.706785 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 265/525] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 24 16:43:49 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:43:49.963340 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:43:49.963763 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:43:49.964261 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:43:49.964701 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:43:49.965106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:43:49.973866 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:49.974347 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:49.974775 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:49.975497 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:49.975968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:49.976402 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:49.993243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Getting quotas for project 099d0dfa51be462e9650ab8ce50465fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:43:49.997156 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Getting quotas for user ad81d5c075d64fa8978122e124d00e19 and project 099d0dfa51be462e9650ab8ce50465fb. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:43:50.009091 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:43:50.011374 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:43:50.059443 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4fe9cd26-3115-402c-af8e-e707afc72a8c tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517993 Aug 24 16:43:50.060801 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 261/526] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:43:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 16:43:50.072223 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-37ebf7fc-cb56-489d-9eb4-f0415706e13a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:50.073137 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-37ebf7fc-cb56-489d-9eb4-f0415706e13a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:50.129472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-37ebf7fc-cb56-489d-9eb4-f0415706e13a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:50.136278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-37ebf7fc-cb56-489d-9eb4-f0415706e13a tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1219 microversion: 2.1 time: 0.067894 Aug 24 16:43:50.137004 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 266/527] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:50 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:50.714968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-3e87b03c-b1d1-4fe9-9683-1f90f7a6c5e4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:50.717139 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-3e87b03c-b1d1-4fe9-9683-1f90f7a6c5e4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:50.724209 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3e87b03c-b1d1-4fe9-9683-1f90f7a6c5e4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:50.724768 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3e87b03c-b1d1-4fe9-9683-1f90f7a6c5e4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:50.725274 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3e87b03c-b1d1-4fe9-9683-1f90f7a6c5e4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:50.726045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3e87b03c-b1d1-4fe9-9683-1f90f7a6c5e4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:50.726570 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3e87b03c-b1d1-4fe9-9683-1f90f7a6c5e4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:50.727078 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3e87b03c-b1d1-4fe9-9683-1f90f7a6c5e4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:50.755804 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-3e87b03c-b1d1-4fe9-9683-1f90f7a6c5e4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045411 Aug 24 16:43:50.756385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 262/528] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 24 16:43:50 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:50.818482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-42d9304b-0fe9-4579-8f34-ccec5381bd5d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:50.819006 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-42d9304b-0fe9-4579-8f34-ccec5381bd5d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:50.824823 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42d9304b-0fe9-4579-8f34-ccec5381bd5d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:50.825302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42d9304b-0fe9-4579-8f34-ccec5381bd5d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:50.825732 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42d9304b-0fe9-4579-8f34-ccec5381bd5d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:50.826413 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42d9304b-0fe9-4579-8f34-ccec5381bd5d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:50.826859 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42d9304b-0fe9-4579-8f34-ccec5381bd5d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:50.827278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-42d9304b-0fe9-4579-8f34-ccec5381bd5d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:50.853587 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-42d9304b-0fe9-4579-8f34-ccec5381bd5d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Going to try to terminate instance {{(pid=127166) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:43:50.928330 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-42d9304b-0fe9-4579-8f34-ccec5381bd5d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 204 len: 0 microversion: 2.20 time: 0.113459 Aug 24 16:43:50.928916 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 267/529] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 24 16:43:50 2022] DELETE /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:43:50.937103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:50.938372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:50.944345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:50.944813 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:50.945236 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:50.945909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:50.946352 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:50.946767 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:51.080352 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:51.088430 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:51.089939 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:51.091080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-003db6d7-8bff-4449-bd63-b51d2caa4a32 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.157864 Aug 24 16:43:51.091625 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 263/530] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:43:50 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:43:51.158658 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-afcbae41-bfb8-45f7-af24-97479c1ebcb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:51.159392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-afcbae41-bfb8-45f7-af24-97479c1ebcb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:51.165371 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-afcbae41-bfb8-45f7-af24-97479c1ebcb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:51.165852 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-afcbae41-bfb8-45f7-af24-97479c1ebcb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:51.166291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-afcbae41-bfb8-45f7-af24-97479c1ebcb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:51.166980 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-afcbae41-bfb8-45f7-af24-97479c1ebcb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:51.167434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-afcbae41-bfb8-45f7-af24-97479c1ebcb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:51.167860 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-afcbae41-bfb8-45f7-af24-97479c1ebcb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:51.231484 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-afcbae41-bfb8-45f7-af24-97479c1ebcb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:51.239263 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-afcbae41-bfb8-45f7-af24-97479c1ebcb9 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1279 microversion: 2.1 time: 0.084947 Aug 24 16:43:51.239830 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 268/531] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:51 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:52.114964 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:52.115563 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:52.121443 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:52.121916 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:52.122337 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:52.123016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:52.123461 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:52.123875 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:52.253501 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:52.255834 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:52.260952 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d183dd20-9ee6-42e9-9fb4-79dcf2c8a7be tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:52.261693 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d183dd20-9ee6-42e9-9fb4-79dcf2c8a7be tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:52.263374 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:52.264904 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:52.266045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-44a37f6c-12f0-4d67-8055-be16633ecee4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.155624 Aug 24 16:43:52.267091 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 264/532] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:43:52 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:43:52.268596 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d183dd20-9ee6-42e9-9fb4-79dcf2c8a7be tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:52.269159 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d183dd20-9ee6-42e9-9fb4-79dcf2c8a7be tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:52.269668 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d183dd20-9ee6-42e9-9fb4-79dcf2c8a7be tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:52.270448 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d183dd20-9ee6-42e9-9fb4-79dcf2c8a7be tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:52.270975 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d183dd20-9ee6-42e9-9fb4-79dcf2c8a7be tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:52.271472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d183dd20-9ee6-42e9-9fb4-79dcf2c8a7be tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:52.332700 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d183dd20-9ee6-42e9-9fb4-79dcf2c8a7be tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:52.340148 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d183dd20-9ee6-42e9-9fb4-79dcf2c8a7be tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1279 microversion: 2.1 time: 0.083262 Aug 24 16:43:52.340718 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 269/533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:52 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:53.289659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:53.290379 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:53.297529 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:53.298891 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:53.299380 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:53.300154 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:53.300781 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:53.301320 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:53.361250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c2a8eac9-9a54-495a-a498-d2df7cb85c44 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:53.362400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c2a8eac9-9a54-495a-a498-d2df7cb85c44 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:53.368796 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2a8eac9-9a54-495a-a498-d2df7cb85c44 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:53.369520 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2a8eac9-9a54-495a-a498-d2df7cb85c44 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:53.370228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2a8eac9-9a54-495a-a498-d2df7cb85c44 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:53.371183 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2a8eac9-9a54-495a-a498-d2df7cb85c44 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:53.371737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2a8eac9-9a54-495a-a498-d2df7cb85c44 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:53.372282 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c2a8eac9-9a54-495a-a498-d2df7cb85c44 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:53.599390 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:53.608216 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:53.609838 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:53.611596 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-58fe42e9-dc1c-4e45-a500-5fb881b0d496 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 200 len: 1721 microversion: 2.20 time: 0.325875 Aug 24 16:43:53.612546 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 265/534] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:43:53 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 1721 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:43:53.645874 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c2a8eac9-9a54-495a-a498-d2df7cb85c44 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:53.654127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c2a8eac9-9a54-495a-a498-d2df7cb85c44 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1319 microversion: 2.1 time: 0.297302 Aug 24 16:43:53.654727 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 270/535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:53 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:53.938874 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-3ea5e5d8-497d-4376-9422-d9b05a4a043b req-917387bb-1d51-4096-8353-82f5aebee00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66f46124-a6dc-4300-88a6-3143240719da", "name": "network-vif-deleted", "tag": "f4013556-5bff-4eef-bfeb-7c2f27b64c4a"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:53.943859 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:53.949970 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-3ea5e5d8-497d-4376-9422-d9b05a4a043b req-917387bb-1d51-4096-8353-82f5aebee00e service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:53.950732 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-3ea5e5d8-497d-4376-9422-d9b05a4a043b req-917387bb-1d51-4096-8353-82f5aebee00e service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:53.951350 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-3ea5e5d8-497d-4376-9422-d9b05a4a043b req-917387bb-1d51-4096-8353-82f5aebee00e service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:53.967138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-3ea5e5d8-497d-4376-9422-d9b05a4a043b req-917387bb-1d51-4096-8353-82f5aebee00e service nova] Creating event network-vif-deleted:f4013556-5bff-4eef-bfeb-7c2f27b64c4a for instance 66f46124-a6dc-4300-88a6-3143240719da on hv-cinder-77957 Aug 24 16:43:53.975583 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-3ea5e5d8-497d-4376-9422-d9b05a4a043b req-917387bb-1d51-4096-8353-82f5aebee00e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040490 Aug 24 16:43:53.980542 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 266/536] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:54.152173 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-8064068d-417e-49b5-9a8d-cf77419730ac req-0e37ffa6-785a-4b39-be29-4149a6bfd2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09c4198-9832-418c-874e-61f39215eb6e", "tag": "1347db72-d8f4-4c41-9959-48a3ae631b36"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:54.166276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-8064068d-417e-49b5-9a8d-cf77419730ac req-0e37ffa6-785a-4b39-be29-4149a6bfd2ac service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:54.167088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-8064068d-417e-49b5-9a8d-cf77419730ac req-0e37ffa6-785a-4b39-be29-4149a6bfd2ac service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:54.167510 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-8064068d-417e-49b5-9a8d-cf77419730ac req-0e37ffa6-785a-4b39-be29-4149a6bfd2ac service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:54.181459 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-8064068d-417e-49b5-9a8d-cf77419730ac req-0e37ffa6-785a-4b39-be29-4149a6bfd2ac service nova] Creating event network-changed:1347db72-d8f4-4c41-9959-48a3ae631b36 for instance f09c4198-9832-418c-874e-61f39215eb6e on hv-cinder-77957 Aug 24 16:43:54.189876 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-8064068d-417e-49b5-9a8d-cf77419730ac req-0e37ffa6-785a-4b39-be29-4149a6bfd2ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045388 Aug 24 16:43:54.191183 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 271/537] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:54.640819 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:54.641893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:54.657462 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:54.657962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:54.659651 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:54.660434 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:54.661654 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:54.662090 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:54.676796 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] HTTP exception thrown: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:43:54.678003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7a75067c-763d-410b-ac96-ee60504ed7e6 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:54.679136 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-7a75067c-763d-410b-ac96-ee60504ed7e6 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Request method failure captured: Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da HTTP/1.1 Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlQ_Wh_PdJNBfQP53zSmmsIgXSPgoAenZWiRIdeNAzJL1NuvP2IPV_FM2rNRsFyQRBR_YsPqjjiVH0ceCMVtfVHb-YquigFy_7rVxcq957Z-HJJY-AoRdqXXst444QJoxh5Mn47HHBCQQt--9mkqAODak3rZTqiXWwGZLbDmzK9D2gY Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:43:54.679766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cdf93612acce4a868bf2105a6567855b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 79d593b826c64087bac576d2204302b4 Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:43:54.681448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '66f46124-a6dc-4300-88a6-3143240719da'} Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:43:54.682359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:43:54.683764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:43:54.685828 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Returning 404 to user: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:43:54.686836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ed423793-338d-476e-b379-5c1e4c48baa6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 404 len: 111 microversion: 2.20 time: 0.052074 Aug 24 16:43:54.692231 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 267/538] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:43:54 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:43:54.697488 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8910859c-ed48-4c40-90ac-8c0269acc155 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '.version_select at 0x7f063aca3b80>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:54.698738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a75067c-763d-410b-ac96-ee60504ed7e6 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:54.700331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a75067c-763d-410b-ac96-ee60504ed7e6 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:54.701040 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a75067c-763d-410b-ac96-ee60504ed7e6 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:54.702166 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a75067c-763d-410b-ac96-ee60504ed7e6 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:54.702716 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a75067c-763d-410b-ac96-ee60504ed7e6 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:54.703252 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7a75067c-763d-410b-ac96-ee60504ed7e6 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:54.719806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8910859c-ed48-4c40-90ac-8c0269acc155 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-15944065" status: 204 len: 0 microversion: 2.20 time: 0.026236 Aug 24 16:43:54.720712 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 268/539] 10.222.0.52 () {60 vars in 1256 bytes} [Wed Aug 24 16:43:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-15944065 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:43:54.732327 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:54.917699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-7a75067c-763d-410b-ac96-ee60504ed7e6 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:54.931781 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7a75067c-763d-410b-ac96-ee60504ed7e6 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1319 microversion: 2.1 time: 0.258968 Aug 24 16:43:54.932403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 272/540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:54 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:55.511953 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-fec223e1-6292-489d-8a17-bc015f7beafb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Action: 'create', calling method: .version_select at 0x7f063ab32790>, body: {"keypair": {"name": "tempest-keypair-732139095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdH1RqP5vFAHOg6UigFXpElScFPQECKSq0vOsX9XFhTRB29/z+XuaOWe4t3YD5c2Y0OtM4nyHUOILyyA6+9teYXwEoLzzQKfEAUYCBofdsdY5W66iTIfQ6467/7scHdJA=="}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:55.528907 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-fec223e1-6292-489d-8a17-bc015f7beafb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Getting quotas for project cdf93612acce4a868bf2105a6567855b. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:43:55.533267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-fec223e1-6292-489d-8a17-bc015f7beafb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Getting quotas for user 79d593b826c64087bac576d2204302b4 and project cdf93612acce4a868bf2105a6567855b. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:43:55.557997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-fec223e1-6292-489d-8a17-bc015f7beafb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050259 Aug 24 16:43:55.558593 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 269/541] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Aug 24 16:43:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 16:43:55.958570 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4a946afd-60a5-447a-a49d-d79ff7f710bd tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:55.959348 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-4a946afd-60a5-447a-a49d-d79ff7f710bd tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:55.971600 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4a946afd-60a5-447a-a49d-d79ff7f710bd tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:55.972583 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4a946afd-60a5-447a-a49d-d79ff7f710bd tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:55.973222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4a946afd-60a5-447a-a49d-d79ff7f710bd tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:55.974332 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4a946afd-60a5-447a-a49d-d79ff7f710bd tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:55.974963 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4a946afd-60a5-447a-a49d-d79ff7f710bd tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:55.975675 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4a946afd-60a5-447a-a49d-d79ff7f710bd tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:56.228129 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-4a946afd-60a5-447a-a49d-d79ff7f710bd tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:56.237673 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-4a946afd-60a5-447a-a49d-d79ff7f710bd tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1319 microversion: 2.1 time: 0.286272 Aug 24 16:43:56.239085 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 273/542] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:55 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:57.036285 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1306750634", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dd51ca4-bcd8-48ce-8f00-e968b2b4f315"}], "security_groups": [{"name": "tempest-securitygroup--1613637046"}], "key_name": "tempest-keypair-732139095", "user_data": "}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:57.136408 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] validate_networks() for [('5dd51ca4-bcd8-48ce-8f00-e968b2b4f315', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:43:57.260592 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b7bb9b35-c79f-4aaf-9663-90e85c008335 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:57.261420 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b7bb9b35-c79f-4aaf-9663-90e85c008335 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:57.267856 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b7bb9b35-c79f-4aaf-9663-90e85c008335 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:57.268488 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b7bb9b35-c79f-4aaf-9663-90e85c008335 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:57.269070 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b7bb9b35-c79f-4aaf-9663-90e85c008335 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:57.269889 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b7bb9b35-c79f-4aaf-9663-90e85c008335 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:57.270447 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b7bb9b35-c79f-4aaf-9663-90e85c008335 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:57.270969 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b7bb9b35-c79f-4aaf-9663-90e85c008335 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:57.481892 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b7bb9b35-c79f-4aaf-9663-90e85c008335 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:57.490684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b7bb9b35-c79f-4aaf-9663-90e85c008335 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1319 microversion: 2.1 time: 0.233824 Aug 24 16:43:57.491266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 274/543] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:57 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:43:57.579064 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:43:57.579637 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:43:57.580162 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:43:57.580586 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:43:57.581000 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:43:57.589890 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:57.590377 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:57.590816 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:57.591548 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:57.592035 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:57.592463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:57.609319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Getting quotas for project cdf93612acce4a868bf2105a6567855b. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:43:57.613836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Getting quotas for user 79d593b826c64087bac576d2204302b4 and project cdf93612acce4a868bf2105a6567855b. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:43:57.624781 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:43:57.627111 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:43:57.673575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a242a473-b96b-4170-a319-a2c32091d4e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.641297 Aug 24 16:43:57.674415 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 270/544] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Aug 24 16:43:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 16:43:57.685316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c42d982e-9460-4f76-bbee-7246653ccf0a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:57.685987 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c42d982e-9460-4f76-bbee-7246653ccf0a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:57.740623 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c42d982e-9460-4f76-bbee-7246653ccf0a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:57.748086 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c42d982e-9460-4f76-bbee-7246653ccf0a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:57.749858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c42d982e-9460-4f76-bbee-7246653ccf0a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:57.751008 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c42d982e-9460-4f76-bbee-7246653ccf0a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1281 microversion: 2.20 time: 0.069768 Aug 24 16:43:57.751645 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 275/545] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:43:57 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:43:58.512416 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c02630f6-4882-437b-8397-65bda21fe1db tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:58.513031 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c02630f6-4882-437b-8397-65bda21fe1db tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:58.521897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c02630f6-4882-437b-8397-65bda21fe1db tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:58.522384 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c02630f6-4882-437b-8397-65bda21fe1db tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:58.522819 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c02630f6-4882-437b-8397-65bda21fe1db tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:58.523784 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c02630f6-4882-437b-8397-65bda21fe1db tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:58.524293 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c02630f6-4882-437b-8397-65bda21fe1db tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:58.524711 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c02630f6-4882-437b-8397-65bda21fe1db tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:58.658876 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c02630f6-4882-437b-8397-65bda21fe1db tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:58.668064 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c02630f6-4882-437b-8397-65bda21fe1db tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1319 microversion: 2.1 time: 0.160009 Aug 24 16:43:58.668885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 271/546] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:58 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:58.773951 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:58.775251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:58.780947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:58.783339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:58.783918 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:58.784696 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:58.785302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:58.785836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:58.786328 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:58.855991 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:58.865323 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:58.866840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:58.867956 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-015cb641-700a-4bc5-8df7-550cc183ed6b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1339 microversion: 2.20 time: 0.098228 Aug 24 16:43:58.868521 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 276/547] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:43:58 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:43:59.379273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-fee5ab68-9115-4cd2-aef8-261d140fdedb req-9929409b-142d-44f8-8270-7fb480458bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09c4198-9832-418c-874e-61f39215eb6e", "name": "network-vif-plugged", "status": "completed", "tag": "1347db72-d8f4-4c41-9959-48a3ae631b36"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:43:59.396480 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-fee5ab68-9115-4cd2-aef8-261d140fdedb req-9929409b-142d-44f8-8270-7fb480458bd9 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:59.397178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-fee5ab68-9115-4cd2-aef8-261d140fdedb req-9929409b-142d-44f8-8270-7fb480458bd9 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:59.398747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-fee5ab68-9115-4cd2-aef8-261d140fdedb req-9929409b-142d-44f8-8270-7fb480458bd9 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:59.417680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-fee5ab68-9115-4cd2-aef8-261d140fdedb req-9929409b-142d-44f8-8270-7fb480458bd9 service nova] Creating event network-vif-plugged:1347db72-d8f4-4c41-9959-48a3ae631b36 for instance f09c4198-9832-418c-874e-61f39215eb6e on hv-cinder-77957 Aug 24 16:43:59.424109 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-fee5ab68-9115-4cd2-aef8-261d140fdedb req-9929409b-142d-44f8-8270-7fb480458bd9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056331 Aug 24 16:43:59.425181 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 272/548] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:43:59.694186 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2716459a-f83f-4bc4-9723-2c76fb293bd8 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:59.694832 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2716459a-f83f-4bc4-9723-2c76fb293bd8 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:59.700813 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2716459a-f83f-4bc4-9723-2c76fb293bd8 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:59.701303 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2716459a-f83f-4bc4-9723-2c76fb293bd8 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:59.701739 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2716459a-f83f-4bc4-9723-2c76fb293bd8 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:59.702462 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2716459a-f83f-4bc4-9723-2c76fb293bd8 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:59.702919 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2716459a-f83f-4bc4-9723-2c76fb293bd8 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:59.703341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2716459a-f83f-4bc4-9723-2c76fb293bd8 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:59.835014 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2716459a-f83f-4bc4-9723-2c76fb293bd8 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:43:59.843162 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2716459a-f83f-4bc4-9723-2c76fb293bd8 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1319 microversion: 2.1 time: 0.152876 Aug 24 16:43:59.843878 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 277/549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:43:59 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:43:59.892870 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:43:59.893570 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:43:59.899980 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:59.900467 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:59.900899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:43:59.901587 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:43:59.902038 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:43:59.902460 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:00.039396 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-a6438e7b-dda7-47b1-89c7-7bd795e9f6e0 req-0cd04a29-5a3a-489f-bdd2-7a1c30fb5aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e736aeb-6bda-4b29-97e9-4f697ccdf966", "tag": "3cb1bcfc-1858-4dec-acc8-8e6b442af514"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:00.062465 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a6438e7b-dda7-47b1-89c7-7bd795e9f6e0 req-0cd04a29-5a3a-489f-bdd2-7a1c30fb5aa4 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:00.063807 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a6438e7b-dda7-47b1-89c7-7bd795e9f6e0 req-0cd04a29-5a3a-489f-bdd2-7a1c30fb5aa4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:00.064515 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a6438e7b-dda7-47b1-89c7-7bd795e9f6e0 req-0cd04a29-5a3a-489f-bdd2-7a1c30fb5aa4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:00.076639 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-a6438e7b-dda7-47b1-89c7-7bd795e9f6e0 req-0cd04a29-5a3a-489f-bdd2-7a1c30fb5aa4 service nova] Creating event network-changed:3cb1bcfc-1858-4dec-acc8-8e6b442af514 for instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 on hv-cinder-77957 Aug 24 16:44:00.083189 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-a6438e7b-dda7-47b1-89c7-7bd795e9f6e0 req-0cd04a29-5a3a-489f-bdd2-7a1c30fb5aa4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048484 Aug 24 16:44:00.084657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 278/550] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:00.276444 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:00.285135 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:00.286652 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:00.287790 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8955bf4d-a096-471a-a47c-9a7c72e7183b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1407 microversion: 2.20 time: 0.400913 Aug 24 16:44:00.288383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 273/551] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:43:59 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:44:00.865868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5481908e-9845-48f3-b456-6574aa2beae0 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:00.866574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5481908e-9845-48f3-b456-6574aa2beae0 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:00.873054 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5481908e-9845-48f3-b456-6574aa2beae0 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:00.873546 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5481908e-9845-48f3-b456-6574aa2beae0 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:00.874081 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5481908e-9845-48f3-b456-6574aa2beae0 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:00.874680 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5481908e-9845-48f3-b456-6574aa2beae0 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:00.875198 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5481908e-9845-48f3-b456-6574aa2beae0 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:00.876250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5481908e-9845-48f3-b456-6574aa2beae0 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:01.007730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5481908e-9845-48f3-b456-6574aa2beae0 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:01.015419 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5481908e-9845-48f3-b456-6574aa2beae0 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1319 microversion: 2.1 time: 0.154193 Aug 24 16:44:01.016003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 279/552] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:00 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:01.309827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:01.310373 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:01.316503 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:01.316986 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:01.317417 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:01.318104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:01.318550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:01.318966 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:01.453036 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:01.462588 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:01.464598 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:01.465929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ca5cdca8-6c26-4e87-9174-51bae7c96350 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1407 microversion: 2.20 time: 0.160416 Aug 24 16:44:01.466513 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 274/553] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:01 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:44:02.036680 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e16c49c3-8177-46ce-849f-a183db224934 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:02.038358 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e16c49c3-8177-46ce-849f-a183db224934 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:02.044685 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e16c49c3-8177-46ce-849f-a183db224934 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:02.045173 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e16c49c3-8177-46ce-849f-a183db224934 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:02.045615 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e16c49c3-8177-46ce-849f-a183db224934 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:02.046316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e16c49c3-8177-46ce-849f-a183db224934 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:02.046773 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e16c49c3-8177-46ce-849f-a183db224934 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:02.047197 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e16c49c3-8177-46ce-849f-a183db224934 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:02.174034 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e16c49c3-8177-46ce-849f-a183db224934 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:02.182629 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e16c49c3-8177-46ce-849f-a183db224934 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1508 microversion: 2.1 time: 0.149989 Aug 24 16:44:02.183392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 280/554] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:02 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:02.203120 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-693640c5-a698-46a4-b1ae-b81a947f5249 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b6f1789-7ee0-4afe-8745-467417e27efb", "device": "/dev/sdb"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:02.205852 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-693640c5-a698-46a4-b1ae-b81a947f5249 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:02.211713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-693640c5-a698-46a4-b1ae-b81a947f5249 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:02.212226 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-693640c5-a698-46a4-b1ae-b81a947f5249 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:02.212662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-693640c5-a698-46a4-b1ae-b81a947f5249 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:02.213343 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-693640c5-a698-46a4-b1ae-b81a947f5249 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:02.213797 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-693640c5-a698-46a4-b1ae-b81a947f5249 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:02.214214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-693640c5-a698-46a4-b1ae-b81a947f5249 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:02.491422 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:02.492057 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:02.497954 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:02.498429 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:02.498858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:02.499533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:02.500002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:02.500420 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:02.652958 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:02.662627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:02.664163 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:02.665297 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-201580a2-cc28-4731-9284-e9bfab72e9bb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1407 microversion: 2.20 time: 0.177724 Aug 24 16:44:02.665916 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 281/555] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:02 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:44:02.741621 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-693640c5-a698-46a4-b1ae-b81a947f5249 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "POST /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542193 Aug 24 16:44:02.742151 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 275/556] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:44:02 2022] POST /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e/os-volume_attachments => generated 194 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:03.687339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:03.688464 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:03.694333 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:03.694809 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:03.695233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:03.695909 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:03.696383 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:03.696808 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:03.825972 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:03.834980 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:03.836508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:03.837586 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-421408f0-a549-4041-a45d-42435580a0a6 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1407 microversion: 2.20 time: 0.154123 Aug 24 16:44:03.838144 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 282/557] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:03 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:44:04.861287 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:04.861968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:04.868116 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:04.868597 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:04.869025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:04.869703 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:04.870152 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:04.870570 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:05.002088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:05.010521 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:05.012049 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:05.013145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a4a6f0fe-0819-4abf-b7f0-9497a6c1b9e3 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1407 microversion: 2.20 time: 0.156852 Aug 24 16:44:05.013693 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 276/558] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:04 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:44:06.036315 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:06.036921 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:06.042946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:06.043365 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:06.043799 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:06.044515 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:06.044960 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:06.045412 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:06.176388 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:06.185165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:06.186652 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:06.187736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6182044d-59b8-4be7-acbd-8b1a9fe42dea tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1407 microversion: 2.20 time: 0.155781 Aug 24 16:44:06.188324 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 283/559] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:06 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:44:07.210958 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:07.211571 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:07.218136 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:07.218622 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:07.219059 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:07.219749 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:07.220236 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:07.221452 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:07.358912 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:07.368242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:07.369810 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:07.370918 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c74f34fa-23c7-42b1-9dc4-9e85894b9207 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1407 microversion: 2.20 time: 0.163887 Aug 24 16:44:07.371966 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 277/560] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:07 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:44:07.425737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-9eaed290-f0c0-440f-a84f-abb6ae2c9f13 req-98034a1e-81f1-43f2-aab5-743361740fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e736aeb-6bda-4b29-97e9-4f697ccdf966", "name": "network-vif-plugged", "status": "completed", "tag": "3cb1bcfc-1858-4dec-acc8-8e6b442af514"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:07.436192 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-9eaed290-f0c0-440f-a84f-abb6ae2c9f13 req-98034a1e-81f1-43f2-aab5-743361740fff service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:07.436682 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-9eaed290-f0c0-440f-a84f-abb6ae2c9f13 req-98034a1e-81f1-43f2-aab5-743361740fff service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:07.437120 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-9eaed290-f0c0-440f-a84f-abb6ae2c9f13 req-98034a1e-81f1-43f2-aab5-743361740fff service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:07.449591 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-9eaed290-f0c0-440f-a84f-abb6ae2c9f13 req-98034a1e-81f1-43f2-aab5-743361740fff service nova] Creating event network-vif-plugged:3cb1bcfc-1858-4dec-acc8-8e6b442af514 for instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 on hv-cinder-77957 Aug 24 16:44:07.454350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-9eaed290-f0c0-440f-a84f-abb6ae2c9f13 req-98034a1e-81f1-43f2-aab5-743361740fff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035331 Aug 24 16:44:07.455657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 284/561] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:08.393182 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:08.393809 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:08.395701 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=4 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:08.396372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=16 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:08.402955 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:08.403367 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:08.403792 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:08.404499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:08.404944 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:08.405356 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:08.538216 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:08.546216 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:08.547714 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:08.549484 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-64eb5b0e-5c98-49b4-90ae-82bfc7f1f59c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1407 microversion: 2.20 time: 0.159732 Aug 24 16:44:08.550061 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 278/562] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:08 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:44:09.569996 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=4 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:09.574466 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:09.575146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:09.582650 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:09.583133 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:09.583563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:09.584306 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:09.584755 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:09.585194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:09.724291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:09.732908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:09.734413 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:09.735555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ebe11afa-22e1-40b6-ab20-14966eed1e85 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1598 microversion: 2.20 time: 0.166638 Aug 24 16:44:09.737186 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 285/563] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:09 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:44:09.758622 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-85b51503-7b39-49b8-bf36-6f982ee0228c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:09.759136 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-85b51503-7b39-49b8-bf36-6f982ee0228c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:09.765439 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-85b51503-7b39-49b8-bf36-6f982ee0228c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:09.765913 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-85b51503-7b39-49b8-bf36-6f982ee0228c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:09.766340 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-85b51503-7b39-49b8-bf36-6f982ee0228c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:09.767040 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-85b51503-7b39-49b8-bf36-6f982ee0228c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:09.767488 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-85b51503-7b39-49b8-bf36-6f982ee0228c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:09.767901 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-85b51503-7b39-49b8-bf36-6f982ee0228c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:09.851439 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-85b51503-7b39-49b8-bf36-6f982ee0228c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096632 Aug 24 16:44:09.852054 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 279/564] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Aug 24 16:44:09 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:44:10.785835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-9514f246-eda0-4fb3-9026-688936a65925 req-f3f77d80-7bc9-443b-b5a5-fb6bdfe2aff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e736aeb-6bda-4b29-97e9-4f697ccdf966", "tag": "3cb1bcfc-1858-4dec-acc8-8e6b442af514"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:10.795014 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-9514f246-eda0-4fb3-9026-688936a65925 req-f3f77d80-7bc9-443b-b5a5-fb6bdfe2aff4 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:10.795581 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-9514f246-eda0-4fb3-9026-688936a65925 req-f3f77d80-7bc9-443b-b5a5-fb6bdfe2aff4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:10.796109 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-9514f246-eda0-4fb3-9026-688936a65925 req-f3f77d80-7bc9-443b-b5a5-fb6bdfe2aff4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:10.811844 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-9514f246-eda0-4fb3-9026-688936a65925 req-f3f77d80-7bc9-443b-b5a5-fb6bdfe2aff4 service nova] Creating event network-changed:3cb1bcfc-1858-4dec-acc8-8e6b442af514 for instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 on hv-cinder-77957 Aug 24 16:44:10.817903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-9514f246-eda0-4fb3-9026-688936a65925 req-f3f77d80-7bc9-443b-b5a5-fb6bdfe2aff4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036026 Aug 24 16:44:10.818651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 286/565] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:23.219329 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:23.220204 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:23.224913 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e4c645f8-a7c2-4670-8e20-9d29c196956b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:23.225410 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e4c645f8-a7c2-4670-8e20-9d29c196956b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:23.232773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c645f8-a7c2-4670-8e20-9d29c196956b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:23.233335 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c645f8-a7c2-4670-8e20-9d29c196956b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:23.233772 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c645f8-a7c2-4670-8e20-9d29c196956b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:23.234590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c645f8-a7c2-4670-8e20-9d29c196956b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:23.235025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c645f8-a7c2-4670-8e20-9d29c196956b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:23.235448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e4c645f8-a7c2-4670-8e20-9d29c196956b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:23.383141 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.objects.instance [None req-e4c645f8-a7c2-4670-8e20-9d29c196956b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lazy-loading 'services' on Instance uuid f09c4198-9832-418c-874e-61f39215eb6e {{(pid=127165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:44:23.502344 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e4c645f8-a7c2-4670-8e20-9d29c196956b tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e/os-volume_attachments/1b6f1789-7ee0-4afe-8745-467417e27efb" status: 202 len: 0 microversion: 2.1 time: 0.283992 Aug 24 16:44:23.503008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 280/566] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:44:23 2022] DELETE /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e/os-volume_attachments/1b6f1789-7ee0-4afe-8745-467417e27efb => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:44:24.620506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=21 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:24.621248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=69 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:24.625749 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-04165bf8-ef8a-412d-aea4-77411a753933 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:24.626336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-04165bf8-ef8a-412d-aea4-77411a753933 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:24.633519 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04165bf8-ef8a-412d-aea4-77411a753933 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:24.634007 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04165bf8-ef8a-412d-aea4-77411a753933 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:24.634443 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04165bf8-ef8a-412d-aea4-77411a753933 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:24.635140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04165bf8-ef8a-412d-aea4-77411a753933 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:24.635592 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04165bf8-ef8a-412d-aea4-77411a753933 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:24.636051 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-04165bf8-ef8a-412d-aea4-77411a753933 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:24.660706 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-04165bf8-ef8a-412d-aea4-77411a753933 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Going to try to terminate instance {{(pid=127166) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:44:24.738103 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-04165bf8-ef8a-412d-aea4-77411a753933 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 204 len: 0 microversion: 2.1 time: 0.118499 Aug 24 16:44:24.742687 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 287/567] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:44:24 2022] DELETE /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:44:24.748153 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e0d1ffe9-3db8-4236-b77e-798af74041eb tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:24.748871 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e0d1ffe9-3db8-4236-b77e-798af74041eb tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:24.755553 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0d1ffe9-3db8-4236-b77e-798af74041eb tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:24.756077 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0d1ffe9-3db8-4236-b77e-798af74041eb tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:24.756516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0d1ffe9-3db8-4236-b77e-798af74041eb tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:24.757324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0d1ffe9-3db8-4236-b77e-798af74041eb tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:24.757787 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0d1ffe9-3db8-4236-b77e-798af74041eb tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:24.758539 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0d1ffe9-3db8-4236-b77e-798af74041eb tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:24.889418 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e0d1ffe9-3db8-4236-b77e-798af74041eb tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:24.898147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e0d1ffe9-3db8-4236-b77e-798af74041eb tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1514 microversion: 2.1 time: 0.154497 Aug 24 16:44:24.898707 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 281/568] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:24 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:25.920403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c77586fc-0c54-4f24-99ca-77fc2a33933d tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:25.921106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c77586fc-0c54-4f24-99ca-77fc2a33933d tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:25.927122 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c77586fc-0c54-4f24-99ca-77fc2a33933d tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:25.927607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c77586fc-0c54-4f24-99ca-77fc2a33933d tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:25.928076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c77586fc-0c54-4f24-99ca-77fc2a33933d tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:25.928780 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c77586fc-0c54-4f24-99ca-77fc2a33933d tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:25.929236 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c77586fc-0c54-4f24-99ca-77fc2a33933d tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:25.929663 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c77586fc-0c54-4f24-99ca-77fc2a33933d tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:26.113107 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c77586fc-0c54-4f24-99ca-77fc2a33933d tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:26.120712 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c77586fc-0c54-4f24-99ca-77fc2a33933d tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1514 microversion: 2.1 time: 0.204597 Aug 24 16:44:26.121278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 288/569] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:25 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:27.142804 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7b197f7a-9582-4b53-9a68-9cc967eca415 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:27.143444 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7b197f7a-9582-4b53-9a68-9cc967eca415 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:27.150305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b197f7a-9582-4b53-9a68-9cc967eca415 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:27.150794 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b197f7a-9582-4b53-9a68-9cc967eca415 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:27.151233 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b197f7a-9582-4b53-9a68-9cc967eca415 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:27.151960 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b197f7a-9582-4b53-9a68-9cc967eca415 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:27.152419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b197f7a-9582-4b53-9a68-9cc967eca415 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:27.152844 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b197f7a-9582-4b53-9a68-9cc967eca415 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:27.163098 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-c7b554aa-473c-4295-99b7-2850ea5f405f req-8e3828b3-ad8e-4f19-9131-d11b1e09b7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09c4198-9832-418c-874e-61f39215eb6e", "name": "network-vif-deleted", "tag": "1347db72-d8f4-4c41-9959-48a3ae631b36"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:27.173131 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c7b554aa-473c-4295-99b7-2850ea5f405f req-8e3828b3-ad8e-4f19-9131-d11b1e09b7e4 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:27.174175 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c7b554aa-473c-4295-99b7-2850ea5f405f req-8e3828b3-ad8e-4f19-9131-d11b1e09b7e4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:27.174603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c7b554aa-473c-4295-99b7-2850ea5f405f req-8e3828b3-ad8e-4f19-9131-d11b1e09b7e4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:27.185373 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-c7b554aa-473c-4295-99b7-2850ea5f405f req-8e3828b3-ad8e-4f19-9131-d11b1e09b7e4 service nova] Creating event network-vif-deleted:1347db72-d8f4-4c41-9959-48a3ae631b36 for instance f09c4198-9832-418c-874e-61f39215eb6e on hv-cinder-77957 Aug 24 16:44:27.190146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-c7b554aa-473c-4295-99b7-2850ea5f405f req-8e3828b3-ad8e-4f19-9131-d11b1e09b7e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030741 Aug 24 16:44:27.190741 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 289/570] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:44:27.226694 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7b197f7a-9582-4b53-9a68-9cc967eca415 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad81d5c075d64fa8978122e124d00e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099d0dfa51be462e9650ab8ce50465fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:27.236168 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7b197f7a-9582-4b53-9a68-9cc967eca415 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 200 len: 1472 microversion: 2.1 time: 0.097262 Aug 24 16:44:27.237273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 282/571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:27 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 1472 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:28.258953 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:28.259631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] [instance: f09c4198-9832-418c-874e-61f39215eb6e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:28.265730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:28.266210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:28.266657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:28.268317 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:28.268788 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:28.269210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:28.282392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] HTTP exception thrown: Instance f09c4198-9832-418c-874e-61f39215eb6e could not be found. Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Request method failure captured: Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e HTTP/1.1 Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlT4tUzMeIHeDTbNpRszDAF8GoEsKFY7nLyjv6msgXmqb3nPxp-TkrVSJumtJ46xcLdrUCiYG7b73mF48w97YWwCpderde1VMxUEt5HtiELO3DZGCYu48iTIQr-V0eca9IIr7j5aNaWW2JlhqZnEIm50opoPnkwm9I9tJQz2MwX-4ks Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 099d0dfa51be462e9650ab8ce50465fb Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1341701760 Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:44:28.285225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/099d0dfa51be462e9650ab8ce50465fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/099d0dfa51be462e9650ab8ce50465fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/099d0dfa51be462e9650ab8ce50465fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_099d0dfa51be462e9650ab8ce50465fb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-VolumesSnapshotTestJSON-1341701760 Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 099d0dfa51be462e9650ab8ce50465fb Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1341701760 Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-VolumesSnapshotTestJSON-1341701760-project Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: ad81d5c075d64fa8978122e124d00e19 Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-VolumesSnapshotTestJSON-1341701760-project Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance f09c4198-9832-418c-874e-61f39215eb6e could not be found. Aug 24 16:44:28.286840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'f09c4198-9832-418c-874e-61f39215eb6e'} Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f09c4198-9832-418c-874e-61f39215eb6e could not be found. Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:28.287695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f09c4198-9832-418c-874e-61f39215eb6e could not be found. Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f09c4198-9832-418c-874e-61f39215eb6e could not be found. Aug 24 16:44:28.289247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:44:28.290672 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] Returning 404 to user: Instance f09c4198-9832-418c-874e-61f39215eb6e could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:28.290672 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-82093869-889a-4b30-8a3b-4215b50a5360 tempest-VolumesSnapshotTestJSON-1341701760 tempest-VolumesSnapshotTestJSON-1341701760-project] 10.222.0.52 "GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e" status: 404 len: 111 microversion: 2.1 time: 0.032047 Aug 24 16:44:28.290672 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 290/572] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:28 2022] GET /compute/v2.1/servers/f09c4198-9832-418c-874e-61f39215eb6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:44:28.434925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a81c6d4a-1abe-4fdf-b607-966721930f63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:28.435411 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a81c6d4a-1abe-4fdf-b607-966721930f63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:28.442076 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a81c6d4a-1abe-4fdf-b607-966721930f63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:28.442570 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a81c6d4a-1abe-4fdf-b607-966721930f63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:28.443045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a81c6d4a-1abe-4fdf-b607-966721930f63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:28.443892 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a81c6d4a-1abe-4fdf-b607-966721930f63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:28.444396 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a81c6d4a-1abe-4fdf-b607-966721930f63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:28.444815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a81c6d4a-1abe-4fdf-b607-966721930f63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:28.549458 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.objects.instance [None req-a81c6d4a-1abe-4fdf-b607-966721930f63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lazy-loading 'services' on Instance uuid f0aa7b07-8c79-4568-af26-cc2273f85a11 {{(pid=127165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:44:28.631482 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a81c6d4a-1abe-4fdf-b607-966721930f63 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments/242b3fc2-0394-4aee-9406-d2d23c5d8c5f" status: 202 len: 0 microversion: 2.1 time: 0.200297 Aug 24 16:44:28.632060 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 283/573] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:44:28 2022] DELETE /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments/242b3fc2-0394-4aee-9406-d2d23c5d8c5f => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:44:28.640410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-78fc9bfb-c369-4244-abfe-4f8af23917f9 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:28.642671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-78fc9bfb-c369-4244-abfe-4f8af23917f9 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:28.649373 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78fc9bfb-c369-4244-abfe-4f8af23917f9 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:28.650060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78fc9bfb-c369-4244-abfe-4f8af23917f9 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:28.650507 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78fc9bfb-c369-4244-abfe-4f8af23917f9 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:28.651365 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78fc9bfb-c369-4244-abfe-4f8af23917f9 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:28.651914 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78fc9bfb-c369-4244-abfe-4f8af23917f9 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:28.652367 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-78fc9bfb-c369-4244-abfe-4f8af23917f9 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:28.692829 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-78fc9bfb-c369-4244-abfe-4f8af23917f9 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056360 Aug 24 16:44:28.693398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 291/574] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:44:28 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:29.763219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-66b03002-0124-4d42-8a2f-6bd55a42fda5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:29.766256 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-66b03002-0124-4d42-8a2f-6bd55a42fda5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:29.774083 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66b03002-0124-4d42-8a2f-6bd55a42fda5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:29.774811 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66b03002-0124-4d42-8a2f-6bd55a42fda5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:29.777130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66b03002-0124-4d42-8a2f-6bd55a42fda5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:29.779316 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66b03002-0124-4d42-8a2f-6bd55a42fda5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:29.780025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66b03002-0124-4d42-8a2f-6bd55a42fda5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:29.780669 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66b03002-0124-4d42-8a2f-6bd55a42fda5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:29.815230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-66b03002-0124-4d42-8a2f-6bd55a42fda5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109534 Aug 24 16:44:29.815797 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 284/575] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:44:29 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:44:29.896774 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ec6744ce-a63b-4010-a088-6253608fd888 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:29.897296 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ec6744ce-a63b-4010-a088-6253608fd888 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:29.903307 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ec6744ce-a63b-4010-a088-6253608fd888 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:29.903782 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ec6744ce-a63b-4010-a088-6253608fd888 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:29.904308 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ec6744ce-a63b-4010-a088-6253608fd888 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:29.904987 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ec6744ce-a63b-4010-a088-6253608fd888 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:29.905433 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ec6744ce-a63b-4010-a088-6253608fd888 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:29.905848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ec6744ce-a63b-4010-a088-6253608fd888 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:29.930615 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ec6744ce-a63b-4010-a088-6253608fd888 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Going to try to terminate instance {{(pid=127166) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:44:30.004892 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ec6744ce-a63b-4010-a088-6253608fd888 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 204 len: 0 microversion: 2.1 time: 0.111219 Aug 24 16:44:30.005686 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 292/576] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:44:29 2022] DELETE /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:44:30.013811 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7c89e43a-b4a0-4af7-a25b-f6f708b5acc0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:30.014421 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7c89e43a-b4a0-4af7-a25b-f6f708b5acc0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:30.020397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c89e43a-b4a0-4af7-a25b-f6f708b5acc0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:30.020884 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c89e43a-b4a0-4af7-a25b-f6f708b5acc0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:30.021323 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c89e43a-b4a0-4af7-a25b-f6f708b5acc0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:30.022013 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c89e43a-b4a0-4af7-a25b-f6f708b5acc0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:30.022472 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c89e43a-b4a0-4af7-a25b-f6f708b5acc0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:30.023151 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7c89e43a-b4a0-4af7-a25b-f6f708b5acc0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:30.154921 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7c89e43a-b4a0-4af7-a25b-f6f708b5acc0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:30.163375 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7c89e43a-b4a0-4af7-a25b-f6f708b5acc0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1687 microversion: 2.1 time: 0.153418 Aug 24 16:44:30.163964 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 285/577] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:30 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:31.185925 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-aede7682-beed-43c1-a010-4165e53237ee tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:31.186624 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-aede7682-beed-43c1-a010-4165e53237ee tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:31.192617 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aede7682-beed-43c1-a010-4165e53237ee tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:31.193101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aede7682-beed-43c1-a010-4165e53237ee tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:31.193537 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aede7682-beed-43c1-a010-4165e53237ee tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:31.194233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aede7682-beed-43c1-a010-4165e53237ee tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:31.194688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aede7682-beed-43c1-a010-4165e53237ee tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:31.195112 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aede7682-beed-43c1-a010-4165e53237ee tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:31.325266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-aede7682-beed-43c1-a010-4165e53237ee tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:31.333685 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-aede7682-beed-43c1-a010-4165e53237ee tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1687 microversion: 2.1 time: 0.151965 Aug 24 16:44:31.334250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 293/578] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:31 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:32.354614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0f35070c-fcae-4a96-8e14-42a77ad93fa5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:32.355224 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0f35070c-fcae-4a96-8e14-42a77ad93fa5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:32.362227 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0f35070c-fcae-4a96-8e14-42a77ad93fa5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:32.362712 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0f35070c-fcae-4a96-8e14-42a77ad93fa5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:32.363148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0f35070c-fcae-4a96-8e14-42a77ad93fa5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:32.363855 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0f35070c-fcae-4a96-8e14-42a77ad93fa5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:32.364321 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0f35070c-fcae-4a96-8e14-42a77ad93fa5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:32.364747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0f35070c-fcae-4a96-8e14-42a77ad93fa5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:32.507040 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-0f35070c-fcae-4a96-8e14-42a77ad93fa5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:32.515235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0f35070c-fcae-4a96-8e14-42a77ad93fa5 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1687 microversion: 2.1 time: 0.164404 Aug 24 16:44:32.515806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 286/579] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:32 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:33.537469 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-61f97cde-ef20-4040-bb08-612ebca013b0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:33.537992 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-61f97cde-ef20-4040-bb08-612ebca013b0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:33.544002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61f97cde-ef20-4040-bb08-612ebca013b0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:33.544498 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61f97cde-ef20-4040-bb08-612ebca013b0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:33.544935 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61f97cde-ef20-4040-bb08-612ebca013b0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:33.545631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61f97cde-ef20-4040-bb08-612ebca013b0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:33.546090 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61f97cde-ef20-4040-bb08-612ebca013b0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:33.546516 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61f97cde-ef20-4040-bb08-612ebca013b0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:33.682341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-61f97cde-ef20-4040-bb08-612ebca013b0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:33.690642 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-61f97cde-ef20-4040-bb08-612ebca013b0 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1687 microversion: 2.1 time: 0.158007 Aug 24 16:44:33.691208 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 294/580] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:33 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:34.610239 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-2e6fc8e8-89c2-4ff3-8c90-54d0ec59684e req-40f3bd25-b574-431b-8a28-8be190c3cc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0aa7b07-8c79-4568-af26-cc2273f85a11", "name": "network-vif-deleted", "tag": "059a432e-b0cb-433f-af23-9677d8b9ba22"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:34.625960 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-2e6fc8e8-89c2-4ff3-8c90-54d0ec59684e req-40f3bd25-b574-431b-8a28-8be190c3cc51 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:34.626938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-2e6fc8e8-89c2-4ff3-8c90-54d0ec59684e req-40f3bd25-b574-431b-8a28-8be190c3cc51 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:34.627380 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-2e6fc8e8-89c2-4ff3-8c90-54d0ec59684e req-40f3bd25-b574-431b-8a28-8be190c3cc51 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:34.642530 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-2e6fc8e8-89c2-4ff3-8c90-54d0ec59684e req-40f3bd25-b574-431b-8a28-8be190c3cc51 service nova] Creating event network-vif-deleted:059a432e-b0cb-433f-af23-9677d8b9ba22 for instance f0aa7b07-8c79-4568-af26-cc2273f85a11 on hv-cinder-77957 Aug 24 16:44:34.649321 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-2e6fc8e8-89c2-4ff3-8c90-54d0ec59684e req-40f3bd25-b574-431b-8a28-8be190c3cc51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044535 Aug 24 16:44:34.649857 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 287/581] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:34.712130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:34.713274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:34.720567 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:34.721161 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:34.721605 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:34.722319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:34.722804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:34.723236 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:34.761895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:34.762398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:34.762837 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:34.763285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lazy-loading 'fault' on Instance uuid f0aa7b07-8c79-4568-af26-cc2273f85a11 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:44:34.810280 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:34.822709 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c63f33be-fb35-447c-b0f7-0d4d337f18b2 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 200 len: 1335 microversion: 2.1 time: 0.115114 Aug 24 16:44:34.823529 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 295/582] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:34 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 1335 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:35.847719 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:35.848947 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: f0aa7b07-8c79-4568-af26-cc2273f85a11] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:35.856650 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:35.857165 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:35.857611 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:35.858582 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:35.859180 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:35.859672 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:35.876929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] HTTP exception thrown: Instance f0aa7b07-8c79-4568-af26-cc2273f85a11 could not be found. Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Request method failure captured: Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 HTTP/1.1 Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlRBhQR1lbs4RdUK-GiSPx-LtPDp2QiIndw-478r2tK5_Xz7olHCVUXWZVJ9gIW6gNDIzpDQZy_qXn2yPdlWeDbyTIMUIxN33m1zYrBlzuNeO2TFzdPUg9oQdxR4xHHbb6xtGJVMQSJxFDwQl1Z_U_5Iw3ml3O21qf7Ig12FpMTmpP0 Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 364a00263e804efe83ae759d9c4c01fb Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:44:35.879526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_364a00263e804efe83ae759d9c4c01fb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 364a00263e804efe83ae759d9c4c01fb Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-ServerRescueNegativeTestJSON-606785984-project Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: fded55a41aae41c6af61382a7c35372e Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606785984-project Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance f0aa7b07-8c79-4568-af26-cc2273f85a11 could not be found. Aug 24 16:44:35.881163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'f0aa7b07-8c79-4568-af26-cc2273f85a11'} Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0aa7b07-8c79-4568-af26-cc2273f85a11 could not be found. Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:35.882268 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0aa7b07-8c79-4568-af26-cc2273f85a11 could not be found. Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0aa7b07-8c79-4568-af26-cc2273f85a11 could not be found. Aug 24 16:44:35.883700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:44:35.885649 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Returning 404 to user: Instance f0aa7b07-8c79-4568-af26-cc2273f85a11 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:35.885649 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-81184594-73ae-4777-88b8-36e99d768e61 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11" status: 404 len: 111 microversion: 2.1 time: 0.039801 Aug 24 16:44:35.885649 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 288/583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:35 2022] GET /compute/v2.1/servers/f0aa7b07-8c79-4568-af26-cc2273f85a11 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:44:35.890210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-07b69a10-66e1-4031-a261-cafb2ad3ba26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '.version_select at 0x7f063ab6c280>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:35.915745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-07b69a10-66e1-4031-a261-cafb2ad3ba26 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548074002" status: 202 len: 0 microversion: 2.1 time: 0.029273 Aug 24 16:44:35.916435 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 296/584] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 24 16:44:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548074002 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:44:40.947562 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c433f22a-ee9e-448d-89c5-a01a873ec5bc tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:40.948107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c433f22a-ee9e-448d-89c5-a01a873ec5bc tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:40.954540 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c433f22a-ee9e-448d-89c5-a01a873ec5bc tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:40.955147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c433f22a-ee9e-448d-89c5-a01a873ec5bc tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:40.955574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c433f22a-ee9e-448d-89c5-a01a873ec5bc tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:40.956289 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c433f22a-ee9e-448d-89c5-a01a873ec5bc tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:40.956731 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c433f22a-ee9e-448d-89c5-a01a873ec5bc tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:40.957148 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c433f22a-ee9e-448d-89c5-a01a873ec5bc tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:40.981099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c433f22a-ee9e-448d-89c5-a01a873ec5bc tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:44:41.055158 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c433f22a-ee9e-448d-89c5-a01a873ec5bc tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "DELETE /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 204 len: 0 microversion: 2.1 time: 0.111381 Aug 24 16:44:41.055730 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 289/585] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:44:40 2022] DELETE /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:44:41.064647 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-da773f06-0381-436c-be28-6525b4302307 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:41.065249 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-da773f06-0381-436c-be28-6525b4302307 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:41.071053 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da773f06-0381-436c-be28-6525b4302307 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:41.071531 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da773f06-0381-436c-be28-6525b4302307 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:41.071969 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da773f06-0381-436c-be28-6525b4302307 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:41.072737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da773f06-0381-436c-be28-6525b4302307 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:41.073188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da773f06-0381-436c-be28-6525b4302307 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:41.073603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da773f06-0381-436c-be28-6525b4302307 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:41.214002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-da773f06-0381-436c-be28-6525b4302307 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:41.222305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-da773f06-0381-436c-be28-6525b4302307 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1506 microversion: 2.1 time: 0.162390 Aug 24 16:44:41.222877 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 297/586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:41 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:42.243771 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8d07b11b-a890-47ca-b2d2-3cd301b03810 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:42.244484 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8d07b11b-a890-47ca-b2d2-3cd301b03810 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:42.250867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d07b11b-a890-47ca-b2d2-3cd301b03810 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:42.251686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d07b11b-a890-47ca-b2d2-3cd301b03810 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:42.252160 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d07b11b-a890-47ca-b2d2-3cd301b03810 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:42.252857 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d07b11b-a890-47ca-b2d2-3cd301b03810 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:42.253341 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d07b11b-a890-47ca-b2d2-3cd301b03810 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:42.253762 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d07b11b-a890-47ca-b2d2-3cd301b03810 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:42.386925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8d07b11b-a890-47ca-b2d2-3cd301b03810 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:42.395511 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8d07b11b-a890-47ca-b2d2-3cd301b03810 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1506 microversion: 2.1 time: 0.155989 Aug 24 16:44:42.396096 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 290/587] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:42 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:43.417213 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a2c83cc2-9dd9-4142-9881-c0e737a353bb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:43.417817 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a2c83cc2-9dd9-4142-9881-c0e737a353bb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:43.425129 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a2c83cc2-9dd9-4142-9881-c0e737a353bb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:43.425618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a2c83cc2-9dd9-4142-9881-c0e737a353bb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:43.426050 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a2c83cc2-9dd9-4142-9881-c0e737a353bb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:43.426742 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a2c83cc2-9dd9-4142-9881-c0e737a353bb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:43.427198 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a2c83cc2-9dd9-4142-9881-c0e737a353bb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:43.427618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a2c83cc2-9dd9-4142-9881-c0e737a353bb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:43.561576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a2c83cc2-9dd9-4142-9881-c0e737a353bb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:43.569412 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a2c83cc2-9dd9-4142-9881-c0e737a353bb tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1506 microversion: 2.1 time: 0.156115 Aug 24 16:44:43.569979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 298/588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:43 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:44.091968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-3c496cb4-2bc0-4e5f-9d4f-88e8060f937f req-6ee757ae-ec31-4c02-b47b-e98b020fbca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbd14e1-e123-4de5-a3a8-a05a401ee2fe", "name": "network-vif-deleted", "tag": "10c3fbc7-c8f0-4c14-8a5c-d7edc10d3544"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:44.102534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-3c496cb4-2bc0-4e5f-9d4f-88e8060f937f req-6ee757ae-ec31-4c02-b47b-e98b020fbca5 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.103019 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-3c496cb4-2bc0-4e5f-9d4f-88e8060f937f req-6ee757ae-ec31-4c02-b47b-e98b020fbca5 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.103452 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-3c496cb4-2bc0-4e5f-9d4f-88e8060f937f req-6ee757ae-ec31-4c02-b47b-e98b020fbca5 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:44.116512 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-3c496cb4-2bc0-4e5f-9d4f-88e8060f937f req-6ee757ae-ec31-4c02-b47b-e98b020fbca5 service nova] Creating event network-vif-deleted:10c3fbc7-c8f0-4c14-8a5c-d7edc10d3544 for instance efbd14e1-e123-4de5-a3a8-a05a401ee2fe on hv-cinder-77957 Aug 24 16:44:44.121184 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-3c496cb4-2bc0-4e5f-9d4f-88e8060f937f req-6ee757ae-ec31-4c02-b47b-e98b020fbca5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033434 Aug 24 16:44:44.122102 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 291/589] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:44:44.590469 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:44.591104 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:44.597844 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.598341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.598882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:44.599540 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.600059 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.600449 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:44.634858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:44.635257 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:44.635684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:44.636154 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lazy-loading 'fault' on Instance uuid efbd14e1-e123-4de5-a3a8-a05a401ee2fe {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:44:44.677305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:44.684233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-593b05a8-ddf0-4cbe-bf67-1957ab513688 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 200 len: 1311 microversion: 2.1 time: 0.097834 Aug 24 16:44:44.684905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 299/590] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:44 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:45.707558 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:45.708288 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: efbd14e1-e123-4de5-a3a8-a05a401ee2fe] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:45.714395 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:45.714880 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:45.715319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:45.716037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:45.716493 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:45.716920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:45.729869 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] HTTP exception thrown: Instance efbd14e1-e123-4de5-a3a8-a05a401ee2fe could not be found. Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Request method failure captured: Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe HTTP/1.1 Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlRBhQR1lbs4RdUK-GiSPx-LtPDp2QiIndw-478r2tK5_Xz7olHCVUXWZVJ9gIW6gNDIzpDQZy_qXn2yPdlWeDbyTIMUIxN33m1zYrBlzuNeO2TFzdPUg9oQdxR4xHHbb6xtGJVMQSJxFDwQl1Z_U_5Iw3ml3O21qf7Ig12FpMTmpP0 Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 364a00263e804efe83ae759d9c4c01fb Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:44:45.731445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_364a00263e804efe83ae759d9c4c01fb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 364a00263e804efe83ae759d9c4c01fb Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-ServerRescueNegativeTestJSON-606785984-project Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: fded55a41aae41c6af61382a7c35372e Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606785984-project Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance efbd14e1-e123-4de5-a3a8-a05a401ee2fe could not be found. Aug 24 16:44:45.733170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'efbd14e1-e123-4de5-a3a8-a05a401ee2fe'} Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efbd14e1-e123-4de5-a3a8-a05a401ee2fe could not be found. Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:45.734104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efbd14e1-e123-4de5-a3a8-a05a401ee2fe could not be found. Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efbd14e1-e123-4de5-a3a8-a05a401ee2fe could not be found. Aug 24 16:44:45.736197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:44:45.737545 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Returning 404 to user: Instance efbd14e1-e123-4de5-a3a8-a05a401ee2fe could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:45.737545 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0862ad6a-ff8f-4883-8df5-3f37bea43665 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe" status: 404 len: 111 microversion: 2.1 time: 0.030729 Aug 24 16:44:45.737545 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 292/591] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:45 2022] GET /compute/v2.1/servers/efbd14e1-e123-4de5-a3a8-a05a401ee2fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:44:45.741337 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fb0a70b6-f16d-48e3-9377-b085ee273806 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:45.741829 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fb0a70b6-f16d-48e3-9377-b085ee273806 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:45.747716 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fb0a70b6-f16d-48e3-9377-b085ee273806 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:45.748224 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fb0a70b6-f16d-48e3-9377-b085ee273806 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:45.748653 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fb0a70b6-f16d-48e3-9377-b085ee273806 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:45.749327 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fb0a70b6-f16d-48e3-9377-b085ee273806 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:45.749778 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fb0a70b6-f16d-48e3-9377-b085ee273806 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:45.750195 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fb0a70b6-f16d-48e3-9377-b085ee273806 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:45.777153 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fb0a70b6-f16d-48e3-9377-b085ee273806 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Going to try to terminate instance {{(pid=127166) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:44:45.809194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:45.853106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-fb0a70b6-f16d-48e3-9377-b085ee273806 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 204 len: 0 microversion: 2.1 time: 0.115322 Aug 24 16:44:45.853691 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 300/592] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:44:45 2022] DELETE /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:44:45.861938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ffc0ab00-b6da-4d2c-a963-8273cd18cb89 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:45.862537 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ffc0ab00-b6da-4d2c-a963-8273cd18cb89 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:45.868329 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ffc0ab00-b6da-4d2c-a963-8273cd18cb89 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:45.868806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ffc0ab00-b6da-4d2c-a963-8273cd18cb89 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:45.869232 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ffc0ab00-b6da-4d2c-a963-8273cd18cb89 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:45.869912 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ffc0ab00-b6da-4d2c-a963-8273cd18cb89 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:45.870363 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ffc0ab00-b6da-4d2c-a963-8273cd18cb89 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:45.870773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ffc0ab00-b6da-4d2c-a963-8273cd18cb89 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:46.004119 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ffc0ab00-b6da-4d2c-a963-8273cd18cb89 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:46.012143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ffc0ab00-b6da-4d2c-a963-8273cd18cb89 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.153971 Aug 24 16:44:46.013141 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 293/593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:45 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:44:47.035079 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e9f3f775-2112-47af-a27d-822af359acef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:47.035819 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e9f3f775-2112-47af-a27d-822af359acef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:47.041753 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f3f775-2112-47af-a27d-822af359acef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:47.042266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f3f775-2112-47af-a27d-822af359acef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:47.042707 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f3f775-2112-47af-a27d-822af359acef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:47.043405 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f3f775-2112-47af-a27d-822af359acef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:47.043859 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f3f775-2112-47af-a27d-822af359acef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:47.044318 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f3f775-2112-47af-a27d-822af359acef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:47.184228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e9f3f775-2112-47af-a27d-822af359acef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:47.193539 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e9f3f775-2112-47af-a27d-822af359acef tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.164003 Aug 24 16:44:47.194123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 301/594] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:47 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:48.222944 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-669e994b-abb0-462f-b97b-a085bbdde597 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:48.223656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-669e994b-abb0-462f-b97b-a085bbdde597 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:48.230877 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669e994b-abb0-462f-b97b-a085bbdde597 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:48.231465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669e994b-abb0-462f-b97b-a085bbdde597 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:48.231993 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669e994b-abb0-462f-b97b-a085bbdde597 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:48.232717 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669e994b-abb0-462f-b97b-a085bbdde597 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:48.233321 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669e994b-abb0-462f-b97b-a085bbdde597 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:48.233750 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-669e994b-abb0-462f-b97b-a085bbdde597 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:48.371720 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-669e994b-abb0-462f-b97b-a085bbdde597 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:48.381989 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-669e994b-abb0-462f-b97b-a085bbdde597 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.163881 Aug 24 16:44:48.382552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 294/595] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:48 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:49.403325 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6f3fb475-d83b-4892-80cf-e589cf993a30 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:49.403923 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6f3fb475-d83b-4892-80cf-e589cf993a30 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:49.410711 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f3fb475-d83b-4892-80cf-e589cf993a30 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:49.411195 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f3fb475-d83b-4892-80cf-e589cf993a30 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:49.411623 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f3fb475-d83b-4892-80cf-e589cf993a30 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:49.412333 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f3fb475-d83b-4892-80cf-e589cf993a30 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:49.412780 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f3fb475-d83b-4892-80cf-e589cf993a30 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:49.413203 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6f3fb475-d83b-4892-80cf-e589cf993a30 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:49.548009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6f3fb475-d83b-4892-80cf-e589cf993a30 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fded55a41aae41c6af61382a7c35372e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364a00263e804efe83ae759d9c4c01fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:49.556711 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6f3fb475-d83b-4892-80cf-e589cf993a30 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 200 len: 1520 microversion: 2.1 time: 0.157248 Aug 24 16:44:49.571122 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 302/596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:49 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:44:49.688033 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-92b27de7-d9d3-4f15-80ba-dc73d4edad65 req-dfd94cc1-2a48-45c3-b8ee-d22069caec54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad10931-9764-4362-a3b6-c5cd27974783", "name": "network-vif-deleted", "tag": "8b8924d9-3ab9-4080-8066-5dffb8805604"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:49.698779 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-92b27de7-d9d3-4f15-80ba-dc73d4edad65 req-dfd94cc1-2a48-45c3-b8ee-d22069caec54 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:49.699262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-92b27de7-d9d3-4f15-80ba-dc73d4edad65 req-dfd94cc1-2a48-45c3-b8ee-d22069caec54 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:49.699874 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-92b27de7-d9d3-4f15-80ba-dc73d4edad65 req-dfd94cc1-2a48-45c3-b8ee-d22069caec54 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:49.712419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-92b27de7-d9d3-4f15-80ba-dc73d4edad65 req-dfd94cc1-2a48-45c3-b8ee-d22069caec54 service nova] Creating event network-vif-deleted:8b8924d9-3ab9-4080-8066-5dffb8805604 for instance 1ad10931-9764-4362-a3b6-c5cd27974783 on hv-cinder-77957 Aug 24 16:44:49.717070 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-92b27de7-d9d3-4f15-80ba-dc73d4edad65 req-dfd94cc1-2a48-45c3-b8ee-d22069caec54 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092320 Aug 24 16:44:49.717650 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 295/597] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:44:50.577177 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:50.577792 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] [instance: 1ad10931-9764-4362-a3b6-c5cd27974783] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:50.584283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:50.584772 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:50.585212 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:50.585908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:50.586366 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:50.586791 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:50.600378 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] HTTP exception thrown: Instance 1ad10931-9764-4362-a3b6-c5cd27974783 could not be found. Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Request method failure captured: Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 HTTP/1.1 Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlRBhQR1lbs4RdUK-GiSPx-LtPDp2QiIndw-478r2tK5_Xz7olHCVUXWZVJ9gIW6gNDIzpDQZy_qXn2yPdlWeDbyTIMUIxN33m1zYrBlzuNeO2TFzdPUg9oQdxR4xHHbb6xtGJVMQSJxFDwQl1Z_U_5Iw3ml3O21qf7Ig12FpMTmpP0 Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 364a00263e804efe83ae759d9c4c01fb Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:44:50.602127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/364a00263e804efe83ae759d9c4c01fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_364a00263e804efe83ae759d9c4c01fb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 364a00263e804efe83ae759d9c4c01fb Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-606785984 Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-ServerRescueNegativeTestJSON-606785984-project Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: fded55a41aae41c6af61382a7c35372e Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-ServerRescueNegativeTestJSON-606785984-project Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 1ad10931-9764-4362-a3b6-c5cd27974783 could not be found. Aug 24 16:44:50.603651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '1ad10931-9764-4362-a3b6-c5cd27974783'} Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad10931-9764-4362-a3b6-c5cd27974783 could not be found. Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:44:50.604789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad10931-9764-4362-a3b6-c5cd27974783 could not be found. Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad10931-9764-4362-a3b6-c5cd27974783 could not be found. Aug 24 16:44:50.606230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:44:50.607649 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] Returning 404 to user: Instance 1ad10931-9764-4362-a3b6-c5cd27974783 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:44:50.607649 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-dcaa9dfa-b648-4da0-b730-d66f75cc8eb1 tempest-ServerRescueNegativeTestJSON-606785984 tempest-ServerRescueNegativeTestJSON-606785984-project] 10.222.0.52 "GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783" status: 404 len: 111 microversion: 2.1 time: 0.030223 Aug 24 16:44:50.607649 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 303/598] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:44:50 2022] GET /compute/v2.1/servers/1ad10931-9764-4362-a3b6-c5cd27974783 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:44:55.370078 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-93d4d5ca-adbe-4b0c-96e0-7ef45f4a6ac8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:55.370666 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-93d4d5ca-adbe-4b0c-96e0-7ef45f4a6ac8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:55.373953 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:55.378815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93d4d5ca-adbe-4b0c-96e0-7ef45f4a6ac8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:55.379302 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93d4d5ca-adbe-4b0c-96e0-7ef45f4a6ac8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:55.379738 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93d4d5ca-adbe-4b0c-96e0-7ef45f4a6ac8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:55.380480 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93d4d5ca-adbe-4b0c-96e0-7ef45f4a6ac8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:55.380925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93d4d5ca-adbe-4b0c-96e0-7ef45f4a6ac8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:55.381349 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-93d4d5ca-adbe-4b0c-96e0-7ef45f4a6ac8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:55.384796 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:55.408450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-93d4d5ca-adbe-4b0c-96e0-7ef45f4a6ac8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/ips" status: 200 len: 151 microversion: 2.20 time: 0.218148 Aug 24 16:44:55.415082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 296/599] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Aug 24 16:44:55 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/ips => generated 151 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:44:57.347641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5865f88d-f0b4-4888-90a8-0175a884f452 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:44:57.348291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5865f88d-f0b4-4888-90a8-0175a884f452 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:57.350457 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:57.355900 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5865f88d-f0b4-4888-90a8-0175a884f452 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.356616 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5865f88d-f0b4-4888-90a8-0175a884f452 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.357225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5865f88d-f0b4-4888-90a8-0175a884f452 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.358103 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5865f88d-f0b4-4888-90a8-0175a884f452 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.358575 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5865f88d-f0b4-4888-90a8-0175a884f452 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.358993 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5865f88d-f0b4-4888-90a8-0175a884f452 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.384248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-5865f88d-f0b4-4888-90a8-0175a884f452 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lazy-loading 'flavor' on Instance uuid 5e736aeb-6bda-4b29-97e9-4f697ccdf966 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:44:57.608578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5865f88d-f0b4-4888-90a8-0175a884f452 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "POST /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/action" status: 202 len: 0 microversion: 2.20 time: 0.264734 Aug 24 16:44:57.609174 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 304/600] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 24 16:44:57 2022] POST /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:44:57.618368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:57.619516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:57.627566 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.628318 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.628899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.629758 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:57.630425 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:57.630994 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:57.765235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:57.773516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:57.775026 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:57.776207 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a91ebf0a-5ade-4008-abb9-639b151be194 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.161769 Aug 24 16:44:57.776767 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 297/601] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:57 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:44:58.802190 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:58.802882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:58.809342 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:58.809824 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:58.810254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:58.810946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:58.811397 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:58.811815 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:58.950940 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:58.959708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:58.961270 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:44:58.962416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-abf85a53-6cd9-4de1-9468-eeaa81e82cc8 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.165979 Aug 24 16:44:58.962972 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 305/602] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:58 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:44:59.986166 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:44:59.986763 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:44:59.993986 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:59.994494 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:59.994930 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:44:59.995618 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:44:59.996195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:44:59.996622 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:00.138570 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:00.147218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:00.148759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:00.149914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-af6e4a11-333f-4018-bd1c-b61622c256ba tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.167723 Aug 24 16:45:00.150496 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 298/603] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:44:59 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:01.173558 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:01.174165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:01.180331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:01.180835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:01.181274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:01.181964 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:01.182442 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:01.182891 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:01.317339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:01.326670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:01.328259 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:01.330259 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-abdbe3d4-c12c-4342-a166-f32c775ab35f tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.160761 Aug 24 16:45:01.330860 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 306/604] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:01 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:02.353443 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:02.354124 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:02.360448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:02.360928 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:02.361351 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:02.362036 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:02.362482 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:02.362900 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:02.504730 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:02.513239 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:02.514763 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:02.515920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-858587aa-a9a4-4700-b5fd-be88a752cb59 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.166598 Aug 24 16:45:02.516986 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 299/605] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:02 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:03.542156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:03.542783 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:03.548955 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:03.549815 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:03.550243 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:03.551111 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:03.551564 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:03.552004 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:03.695898 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:03.705436 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:03.707666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:03.708887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-31fb62ac-c6f9-4526-b91d-b8fe3154a772 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.170618 Aug 24 16:45:03.709450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 307/606] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:03 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:04.731899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:04.732448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:04.739717 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.740246 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.740688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.741417 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:04.741871 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:04.742290 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:04.878338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:04.886566 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:04.888103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:04.889256 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-23919102-4c83-42c1-8013-b91fddb508b4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.161313 Aug 24 16:45:04.889835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 300/607] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:04 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:05.913433 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:05.914108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:05.920819 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:05.921299 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:05.921893 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:05.922484 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:05.923037 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:05.923495 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:06.064136 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:06.072626 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:06.074139 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:06.075295 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-47e83171-2558-40b1-bb00-cfe2272111f9 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.165853 Aug 24 16:45:06.075885 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 308/608] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:05 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:07.098575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:07.099298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:07.106036 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:07.106578 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:07.107094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:07.107787 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:07.108290 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:07.108704 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:07.245164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:07.254419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:07.255930 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:07.257103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8e5fc8cf-e8c1-417e-bdb9-586c10e2eee7 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.162877 Aug 24 16:45:07.257937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 301/609] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:07 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:08.282541 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:08.283797 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:08.290304 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.290730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.291168 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.291927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:08.292496 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:08.292937 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:08.420871 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:08.429546 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:08.431043 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:08.432242 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-06b97382-2243-4cb2-8c0e-d5680eae3d41 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.154330 Aug 24 16:45:08.432800 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 309/610] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:08 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:09.455181 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:09.455993 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:09.462272 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:09.462753 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:09.463178 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:09.463922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:09.464397 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:09.464815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:09.599422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:09.607509 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:09.609123 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:09.610351 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-04a52e6d-3483-4bd9-9195-67b6c1972f7c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.159617 Aug 24 16:45:09.610967 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 302/611] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:09 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:10.633893 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:10.634508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:10.640895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:10.641396 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:10.641832 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:10.643160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:10.643918 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:10.644380 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:10.778445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:10.787568 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:10.789103 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:10.790255 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-23f33218-31d8-4ffc-aec2-fa7586a45033 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.160567 Aug 24 16:45:10.790806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 310/612] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:10 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:11.813498 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:11.814895 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:11.821304 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:11.821800 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:11.822235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:11.822924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:11.823525 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:11.824193 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:11.958996 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:11.967088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:11.968625 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:11.969764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2bebb58c-7281-4c9d-b039-17e03b001fda tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.160348 Aug 24 16:45:11.970897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 303/613] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:11 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:12.994904 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:12.995506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:13.007663 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:13.008190 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:13.008618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:13.009309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:13.009753 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:13.010165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:13.153238 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:13.161776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:13.163280 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:13.164453 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-fe1beff9-ddd3-4e55-b7dc-810b7fe60b98 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.173461 Aug 24 16:45:13.165009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 311/614] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:12 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:14.188026 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:14.188603 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:14.196077 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:14.196590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:14.197081 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:14.197836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:14.198348 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:14.198826 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:14.345557 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:14.353520 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:14.355001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:14.356161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f1adbcc1-f2e4-452b-817d-9e201520c521 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1744 microversion: 2.20 time: 0.172429 Aug 24 16:45:14.356717 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 304/615] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:14 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:15.380294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:15.380905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:15.387444 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:15.387971 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:15.388434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:15.389147 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:15.389622 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:15.390237 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:15.558712 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:15.569198 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:15.571339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:15.572679 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f95b0d32-4a23-440f-a4e4-da5bad922252 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1739 microversion: 2.20 time: 0.196715 Aug 24 16:45:15.573235 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 312/616] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:15 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:16.598080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:16.598698 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:16.610262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:16.613008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:16.614008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:16.614801 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:16.615641 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:16.616275 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:16.823588 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:16.835878 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:16.837855 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:16.839208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d5868452-4d85-493b-964c-1f22f4e2e42a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1739 microversion: 2.20 time: 0.246276 Aug 24 16:45:16.840313 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 305/617] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:16 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:17.863545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:17.864261 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:17.873894 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:17.874395 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:17.875156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:17.875851 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:17.876585 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:17.877341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:17.884084 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:18.054271 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:18.065711 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:18.067541 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:18.068818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-64f4097f-ed9c-448c-a97a-9a1c63b9121b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1739 microversion: 2.20 time: 0.209888 Aug 24 16:45:18.080804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 313/618] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:17 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:18.621383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-cd0ee6f5-3349-459d-b248-ee080244b93d req-ff40e125-97ba-46d1-ad3a-95308ce45a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e736aeb-6bda-4b29-97e9-4f697ccdf966", "name": "network-vif-plugged", "status": "completed", "tag": "3cb1bcfc-1858-4dec-acc8-8e6b442af514"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:18.633966 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-cd0ee6f5-3349-459d-b248-ee080244b93d req-ff40e125-97ba-46d1-ad3a-95308ce45a12 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:18.634569 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-cd0ee6f5-3349-459d-b248-ee080244b93d req-ff40e125-97ba-46d1-ad3a-95308ce45a12 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:18.635071 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-cd0ee6f5-3349-459d-b248-ee080244b93d req-ff40e125-97ba-46d1-ad3a-95308ce45a12 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:18.647666 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-cd0ee6f5-3349-459d-b248-ee080244b93d req-ff40e125-97ba-46d1-ad3a-95308ce45a12 service nova] Creating event network-vif-plugged:3cb1bcfc-1858-4dec-acc8-8e6b442af514 for instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 on hv-cinder-77957 Aug 24 16:45:18.656393 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-cd0ee6f5-3349-459d-b248-ee080244b93d req-ff40e125-97ba-46d1-ad3a-95308ce45a12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214186 Aug 24 16:45:18.657939 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 306/619] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:19.095876 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:19.097232 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:19.105666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:19.106420 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:19.107016 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:19.107908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:19.108540 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:19.109120 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:19.290891 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:19.302822 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:19.304978 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:19.306458 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ca50172b-d91a-4b3c-ac24-ae1176ac8b52 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1739 microversion: 2.20 time: 0.215333 Aug 24 16:45:19.307503 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 314/620] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:19 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:20.344337 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:20.345592 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:20.352209 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:20.352713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:20.353144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:20.354080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:20.354748 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:20.355236 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:20.516364 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:20.530910 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:20.535293 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:20.537216 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1cbf9586-cc16-4a35-96de-3aaa1e608ec1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1739 microversion: 2.20 time: 0.206207 Aug 24 16:45:20.552568 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 307/621] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:20 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:21.561594 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:21.562787 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:21.575105 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:21.575793 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:21.576291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:21.577126 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:21.577600 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:21.578016 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:21.772111 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:21.781529 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:21.783640 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:21.784827 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-da61b989-5de6-480c-83af-84ad5e2a69ae tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1739 microversion: 2.20 time: 0.227307 Aug 24 16:45:21.785545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 315/622] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:21 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:22.808379 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:22.809186 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:22.819146 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:22.819929 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:22.820566 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:22.821419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:22.822033 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:22.822456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:22.978420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:22.991724 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:22.993353 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:22.994651 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2d4f0223-5012-40cc-ac59-040c17715e77 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1739 microversion: 2.20 time: 0.190362 Aug 24 16:45:22.995188 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 308/623] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:22 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:24.036755 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:24.037369 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:24.043367 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:24.043838 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:24.044299 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:24.044978 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:24.045427 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:24.045845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:24.194114 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:24.202837 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:24.204879 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:24.206298 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ff6f4721-489d-4529-93ae-882cccdd2a74 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1739 microversion: 2.20 time: 0.179273 Aug 24 16:45:24.207054 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 316/624] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:24 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:25.230272 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:25.230873 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:25.237423 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:25.237900 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:25.238329 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:25.239013 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:25.239462 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:25.239882 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:25.379555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:25.387662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:25.389210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:25.390350 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-af73af3f-ce54-4cba-8e98-28987164dfe5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1739 microversion: 2.20 time: 0.163982 Aug 24 16:45:25.390902 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 309/625] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:25 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:26.414455 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:26.415080 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:26.421225 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:26.421709 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:26.422143 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:26.422876 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:26.423992 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:26.424421 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:26.557522 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:26.565730 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:26.567231 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:26.568400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a22bbc87-2a48-4b9b-af01-b419e83f5695 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1721 microversion: 2.20 time: 0.157887 Aug 24 16:45:26.568974 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 317/626] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:26 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:27.591725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:27.592330 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:27.595569 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=28 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:27.600841 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:27.601320 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:27.601745 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:27.602430 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:27.602879 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:27.603298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:27.606011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=78 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:27.740175 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:27.748262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:27.749791 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:27.751549 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-124003f9-161c-4657-a411-6117c66273d1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1721 microversion: 2.20 time: 0.163143 Aug 24 16:45:27.752248 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 310/627] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:27 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:28.595163 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-56adb758-34f3-40fe-9953-966ec0e1db4a tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:28.595768 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-56adb758-34f3-40fe-9953-966ec0e1db4a tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:28.597630 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=28 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:28.603366 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56adb758-34f3-40fe-9953-966ec0e1db4a tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.603738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56adb758-34f3-40fe-9953-966ec0e1db4a tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.604236 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56adb758-34f3-40fe-9953-966ec0e1db4a tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.604903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56adb758-34f3-40fe-9953-966ec0e1db4a tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.605350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56adb758-34f3-40fe-9953-966ec0e1db4a tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.605766 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-56adb758-34f3-40fe-9953-966ec0e1db4a tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.629651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-56adb758-34f3-40fe-9953-966ec0e1db4a tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lazy-loading 'flavor' on Instance uuid 8e451e3e-9a42-40af-aff5-e8f8938252db {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:45:28.705944 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-56adb758-34f3-40fe-9953-966ec0e1db4a tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "POST /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db/action" status: 202 len: 0 microversion: 2.1 time: 0.115144 Aug 24 16:45:28.706524 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 318/628] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:45:28 2022] POST /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:45:28.715563 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c33bd368-6754-45a2-ac5f-7e4908d719f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:28.716713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c33bd368-6754-45a2-ac5f-7e4908d719f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:28.724674 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c33bd368-6754-45a2-ac5f-7e4908d719f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.725141 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c33bd368-6754-45a2-ac5f-7e4908d719f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.725565 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c33bd368-6754-45a2-ac5f-7e4908d719f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.726310 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c33bd368-6754-45a2-ac5f-7e4908d719f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.726713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c33bd368-6754-45a2-ac5f-7e4908d719f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.727131 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c33bd368-6754-45a2-ac5f-7e4908d719f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.775555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:28.776433 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:28.783474 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.784265 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.784709 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.785425 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.785899 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.786356 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.920362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c33bd368-6754-45a2-ac5f-7e4908d719f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:28.929302 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c33bd368-6754-45a2-ac5f-7e4908d719f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.218468 Aug 24 16:45:28.929881 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 311/629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:28 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:28.947592 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:28.955871 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:28.957477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:28.958623 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-60456a88-e857-4d72-8432-eda152dd369b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1664 microversion: 2.20 time: 0.187854 Aug 24 16:45:28.959184 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 319/630] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:28 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1664 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:28.980939 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0611c6c6-8219-40ef-b8ce-e8bed3019be2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dc39431-f6e3-4927-93e7-2843f08e3dfa"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:28.983263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0611c6c6-8219-40ef-b8ce-e8bed3019be2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:28.989765 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0611c6c6-8219-40ef-b8ce-e8bed3019be2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.990255 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0611c6c6-8219-40ef-b8ce-e8bed3019be2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.990693 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0611c6c6-8219-40ef-b8ce-e8bed3019be2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:28.991383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0611c6c6-8219-40ef-b8ce-e8bed3019be2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:28.991836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0611c6c6-8219-40ef-b8ce-e8bed3019be2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:28.992288 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0611c6c6-8219-40ef-b8ce-e8bed3019be2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:29.282008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0611c6c6-8219-40ef-b8ce-e8bed3019be2 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "POST /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304957 Aug 24 16:45:29.283362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 312/631] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Aug 24 16:45:28 2022] POST /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 16:45:29.409918 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f85fbf20-5786-4e00-bb6c-3022ae017e68 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:29.410416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f85fbf20-5786-4e00-bb6c-3022ae017e68 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:29.416628 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f85fbf20-5786-4e00-bb6c-3022ae017e68 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:29.417115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f85fbf20-5786-4e00-bb6c-3022ae017e68 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:29.417571 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f85fbf20-5786-4e00-bb6c-3022ae017e68 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:29.418264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f85fbf20-5786-4e00-bb6c-3022ae017e68 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:29.418714 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f85fbf20-5786-4e00-bb6c-3022ae017e68 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:29.419135 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f85fbf20-5786-4e00-bb6c-3022ae017e68 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:29.672001 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f85fbf20-5786-4e00-bb6c-3022ae017e68 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/os-volume_attachments/7dc39431-f6e3-4927-93e7-2843f08e3dfa" status: 202 len: 0 microversion: 2.20 time: 0.266696 Aug 24 16:45:29.672674 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 320/632] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Aug 24 16:45:29 2022] DELETE /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/os-volume_attachments/7dc39431-f6e3-4927-93e7-2843f08e3dfa => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:45:29.732721 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4908a3b3-31c7-4039-ac05-9ec590b3de45 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:29.733307 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4908a3b3-31c7-4039-ac05-9ec590b3de45 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:29.740759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4908a3b3-31c7-4039-ac05-9ec590b3de45 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:29.741237 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4908a3b3-31c7-4039-ac05-9ec590b3de45 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:29.741661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4908a3b3-31c7-4039-ac05-9ec590b3de45 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:29.742340 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4908a3b3-31c7-4039-ac05-9ec590b3de45 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:29.742785 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4908a3b3-31c7-4039-ac05-9ec590b3de45 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:29.743199 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4908a3b3-31c7-4039-ac05-9ec590b3de45 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:29.771754 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4908a3b3-31c7-4039-ac05-9ec590b3de45 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127165) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 16:45:29.838912 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4908a3b3-31c7-4039-ac05-9ec590b3de45 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "POST /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/action" status: 202 len: 0 microversion: 2.20 time: 0.109813 Aug 24 16:45:29.839724 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 313/633] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 24 16:45:29 2022] POST /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:45:29.848528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:29.849248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:29.855527 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:29.856042 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:29.856479 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:29.857172 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:29.857627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:29.858050 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:29.951344 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4cae2117-2372-4b1d-9b1a-21ae722c2560 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:29.952388 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4cae2117-2372-4b1d-9b1a-21ae722c2560 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:29.959350 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cae2117-2372-4b1d-9b1a-21ae722c2560 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:29.959833 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cae2117-2372-4b1d-9b1a-21ae722c2560 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:29.960298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cae2117-2372-4b1d-9b1a-21ae722c2560 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:29.961197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cae2117-2372-4b1d-9b1a-21ae722c2560 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:29.961806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cae2117-2372-4b1d-9b1a-21ae722c2560 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:29.962385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4cae2117-2372-4b1d-9b1a-21ae722c2560 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:30.018348 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:30.027510 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:30.029631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:30.031784 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b942b423-09f5-44a5-8198-0bf31f24b91c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1672 microversion: 2.20 time: 0.187338 Aug 24 16:45:30.033910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 321/634] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:29 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1672 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:30.108853 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4cae2117-2372-4b1d-9b1a-21ae722c2560 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:30.117511 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4cae2117-2372-4b1d-9b1a-21ae722c2560 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.170510 Aug 24 16:45:30.118083 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 314/635] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:29 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:30.393412 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-011d189e-76cc-46a3-8f6f-c954445db4be req-93df048d-c81b-4827-aec1-32da28ace766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e736aeb-6bda-4b29-97e9-4f697ccdf966", "name": "network-vif-unplugged", "status": "completed", "tag": "3cb1bcfc-1858-4dec-acc8-8e6b442af514"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:30.403722 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-011d189e-76cc-46a3-8f6f-c954445db4be req-93df048d-c81b-4827-aec1-32da28ace766 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:30.404177 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-011d189e-76cc-46a3-8f6f-c954445db4be req-93df048d-c81b-4827-aec1-32da28ace766 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:30.404654 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-011d189e-76cc-46a3-8f6f-c954445db4be req-93df048d-c81b-4827-aec1-32da28ace766 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:30.420289 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.compute.server_external_events [req-011d189e-76cc-46a3-8f6f-c954445db4be req-93df048d-c81b-4827-aec1-32da28ace766 service nova] Unable to find a host for instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966. Dropping event network-vif-unplugged {{(pid=127166) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 16:45:30.421254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-011d189e-76cc-46a3-8f6f-c954445db4be req-93df048d-c81b-4827-aec1-32da28ace766 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033677 Aug 24 16:45:30.422207 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 322/636] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 16:45:31.056477 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:31.057143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:31.065090 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:31.065586 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:31.066025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:31.066727 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:31.067262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:31.067589 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:31.141053 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-804bde2b-21a6-47c1-a523-6661257e9eaf tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:31.142493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-804bde2b-21a6-47c1-a523-6661257e9eaf tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:31.148989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-804bde2b-21a6-47c1-a523-6661257e9eaf tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:31.149479 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-804bde2b-21a6-47c1-a523-6661257e9eaf tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:31.150117 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-804bde2b-21a6-47c1-a523-6661257e9eaf tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:31.150704 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-804bde2b-21a6-47c1-a523-6661257e9eaf tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:31.156561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-804bde2b-21a6-47c1-a523-6661257e9eaf tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:31.156985 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-804bde2b-21a6-47c1-a523-6661257e9eaf tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:31.236866 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:31.247355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:31.248888 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:31.250051 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ab0fd092-edab-4049-b450-6eb14f33f742 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.197696 Aug 24 16:45:31.250594 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 315/637] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:31 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:31.305758 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-804bde2b-21a6-47c1-a523-6661257e9eaf tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:31.314238 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-804bde2b-21a6-47c1-a523-6661257e9eaf tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.178736 Aug 24 16:45:31.314386 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 323/638] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:31 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:32.277115 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:32.278364 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:32.289747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:32.290663 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:32.291255 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:32.292231 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:32.292882 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:32.293893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:32.341305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e9e5f7cf-bfc0-40d0-b581-81f1d6dd1572 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:32.342605 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e9e5f7cf-bfc0-40d0-b581-81f1d6dd1572 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:32.362779 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9e5f7cf-bfc0-40d0-b581-81f1d6dd1572 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:32.364933 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9e5f7cf-bfc0-40d0-b581-81f1d6dd1572 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:32.367475 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9e5f7cf-bfc0-40d0-b581-81f1d6dd1572 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:32.371540 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9e5f7cf-bfc0-40d0-b581-81f1d6dd1572 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:32.372780 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9e5f7cf-bfc0-40d0-b581-81f1d6dd1572 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:32.374701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9e5f7cf-bfc0-40d0-b581-81f1d6dd1572 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:32.550063 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:32.565688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:32.570618 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:32.575052 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9f808c0e-fbdc-4280-a13c-b2aa857fe190 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.304018 Aug 24 16:45:32.576048 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 316/639] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:32 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:32.660476 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e9e5f7cf-bfc0-40d0-b581-81f1d6dd1572 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:32.675792 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e9e5f7cf-bfc0-40d0-b581-81f1d6dd1572 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.343429 Aug 24 16:45:32.677194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 324/640] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:32 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:33.609548 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:33.610909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:33.617485 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:33.618053 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:33.618546 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:33.619323 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:33.619840 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:33.620347 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:33.706881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7cab29fe-ecc0-40d3-9355-34aa88c272e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:33.708183 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-7cab29fe-ecc0-40d3-9355-34aa88c272e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:33.729597 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7cab29fe-ecc0-40d3-9355-34aa88c272e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:33.730354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7cab29fe-ecc0-40d3-9355-34aa88c272e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:33.731056 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7cab29fe-ecc0-40d3-9355-34aa88c272e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:33.732535 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7cab29fe-ecc0-40d3-9355-34aa88c272e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:33.733155 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7cab29fe-ecc0-40d3-9355-34aa88c272e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:33.733739 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7cab29fe-ecc0-40d3-9355-34aa88c272e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:33.833576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:33.842734 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:33.844438 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:33.863595 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c8a99d06-d578-453d-8aa5-f4d55769af67 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.240956 Aug 24 16:45:33.864459 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 317/641] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:33 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:33.951820 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-7cab29fe-ecc0-40d3-9355-34aa88c272e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:33.956080 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:33.961323 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7cab29fe-ecc0-40d3-9355-34aa88c272e3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.263031 Aug 24 16:45:33.961907 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 325/642] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:33 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:34.890701 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:34.891367 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:34.899280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:34.900524 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:34.901602 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:34.902505 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:34.903360 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:34.904153 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:34.988471 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3c81ff20-1266-44c3-9c06-08d64e32597e tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:34.990022 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3c81ff20-1266-44c3-9c06-08d64e32597e tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:35.004964 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3c81ff20-1266-44c3-9c06-08d64e32597e tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:35.006096 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3c81ff20-1266-44c3-9c06-08d64e32597e tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:35.006733 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3c81ff20-1266-44c3-9c06-08d64e32597e tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:35.007453 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3c81ff20-1266-44c3-9c06-08d64e32597e tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:35.007915 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3c81ff20-1266-44c3-9c06-08d64e32597e tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:35.014241 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3c81ff20-1266-44c3-9c06-08d64e32597e tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:35.165688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:35.176422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:35.177986 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:35.179523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-20308215-c846-4de3-88ac-df3c714b58d4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.293346 Aug 24 16:45:35.180144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 318/643] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:34 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:35.211400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-3c81ff20-1266-44c3-9c06-08d64e32597e tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:35.219248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3c81ff20-1266-44c3-9c06-08d64e32597e tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.238836 Aug 24 16:45:35.220691 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 326/644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:34 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:36.137171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-631d5522-f6be-4599-8e37-2695593604f5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:36.138533 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-631d5522-f6be-4599-8e37-2695593604f5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:36.150574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-631d5522-f6be-4599-8e37-2695593604f5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:36.151076 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-631d5522-f6be-4599-8e37-2695593604f5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:36.151517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-631d5522-f6be-4599-8e37-2695593604f5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:36.152264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-631d5522-f6be-4599-8e37-2695593604f5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:36.152719 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-631d5522-f6be-4599-8e37-2695593604f5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:36.153144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-631d5522-f6be-4599-8e37-2695593604f5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:36.203645 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:36.205316 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:36.215283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:36.217997 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:36.218621 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:36.220867 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:36.221488 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:36.223075 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:36.229995 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-631d5522-f6be-4599-8e37-2695593604f5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:45:36.377858 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-631d5522-f6be-4599-8e37-2695593604f5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "DELETE /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 204 len: 0 microversion: 2.1 time: 0.244644 Aug 24 16:45:36.379006 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 319/645] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:45:36 2022] DELETE /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:45:36.392143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-da1e8872-792c-4e6f-b5be-76621d003aa3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:36.392143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-da1e8872-792c-4e6f-b5be-76621d003aa3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:36.399379 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-da1e8872-792c-4e6f-b5be-76621d003aa3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:36.400085 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-da1e8872-792c-4e6f-b5be-76621d003aa3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:36.400620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-da1e8872-792c-4e6f-b5be-76621d003aa3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:36.410930 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-da1e8872-792c-4e6f-b5be-76621d003aa3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:36.411570 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-da1e8872-792c-4e6f-b5be-76621d003aa3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:36.412138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-da1e8872-792c-4e6f-b5be-76621d003aa3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:36.586752 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:36.597955 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:36.604551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:36.605749 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8969fa29-cafd-40ca-a36e-d811b28ea9ee tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.407142 Aug 24 16:45:36.609866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 327/646] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:36 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:36.633946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-93274670-f75b-46e3-8966-f028074ab2e4 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:36.634918 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-93274670-f75b-46e3-8966-f028074ab2e4 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:36.642993 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-93274670-f75b-46e3-8966-f028074ab2e4 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:36.643878 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-93274670-f75b-46e3-8966-f028074ab2e4 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:36.644574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-93274670-f75b-46e3-8966-f028074ab2e4 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:36.646218 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-93274670-f75b-46e3-8966-f028074ab2e4 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:36.647113 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-93274670-f75b-46e3-8966-f028074ab2e4 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:36.647741 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-93274670-f75b-46e3-8966-f028074ab2e4 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:36.923105 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-da1e8872-792c-4e6f-b5be-76621d003aa3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:36.942408 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-da1e8872-792c-4e6f-b5be-76621d003aa3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.551895 Aug 24 16:45:36.943521 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 320/647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:36 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:37.101623 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-93274670-f75b-46e3-8966-f028074ab2e4 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:37.112948 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-93274670-f75b-46e3-8966-f028074ab2e4 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1577 microversion: 2.1 time: 0.501253 Aug 24 16:45:37.114684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 328/648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:36 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1577 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:37.637632 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:37.638266 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:37.646033 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:37.646535 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:37.646978 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:37.647911 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:37.649650 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:37.650087 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:37.674312 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:37.974735 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1c159872-f269-46b1-b4d1-d39964861faa tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:37.976143 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1c159872-f269-46b1-b4d1-d39964861faa tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:37.988599 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1c159872-f269-46b1-b4d1-d39964861faa tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:37.990374 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1c159872-f269-46b1-b4d1-d39964861faa tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:37.993159 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1c159872-f269-46b1-b4d1-d39964861faa tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:37.994147 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1c159872-f269-46b1-b4d1-d39964861faa tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:37.994797 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1c159872-f269-46b1-b4d1-d39964861faa tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:37.995406 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1c159872-f269-46b1-b4d1-d39964861faa tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:38.312983 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:38.324933 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:38.329236 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:38.330544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e91398ea-c7dd-4a05-b508-d1efdac00977 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.696820 Aug 24 16:45:38.333993 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 321/649] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:37 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:38.338963 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-869a7d67-105c-4050-994c-93ae86748510 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:38.339834 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-869a7d67-105c-4050-994c-93ae86748510 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:38.347179 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-869a7d67-105c-4050-994c-93ae86748510 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:38.348242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-869a7d67-105c-4050-994c-93ae86748510 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:38.348895 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-869a7d67-105c-4050-994c-93ae86748510 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:38.349830 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-869a7d67-105c-4050-994c-93ae86748510 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:38.350487 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-869a7d67-105c-4050-994c-93ae86748510 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:38.351130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-869a7d67-105c-4050-994c-93ae86748510 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:38.606210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1c159872-f269-46b1-b4d1-d39964861faa tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:38.631494 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1c159872-f269-46b1-b4d1-d39964861faa tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.662427 Aug 24 16:45:38.632469 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 329/650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:37 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:38.725559 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-869a7d67-105c-4050-994c-93ae86748510 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:38.742572 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-869a7d67-105c-4050-994c-93ae86748510 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1577 microversion: 2.1 time: 0.406638 Aug 24 16:45:38.745508 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 322/651] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:38 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1577 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:39.358701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:39.359477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:39.385808 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:39.387649 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:39.390929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:39.400098 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:39.400857 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:39.401386 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:39.654973 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2e04c9cb-9b9f-4239-86d8-2de1eb4398fb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:39.655661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2e04c9cb-9b9f-4239-86d8-2de1eb4398fb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:39.667696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e04c9cb-9b9f-4239-86d8-2de1eb4398fb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:39.668224 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e04c9cb-9b9f-4239-86d8-2de1eb4398fb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:39.668659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e04c9cb-9b9f-4239-86d8-2de1eb4398fb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:39.669372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e04c9cb-9b9f-4239-86d8-2de1eb4398fb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:39.669825 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e04c9cb-9b9f-4239-86d8-2de1eb4398fb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:39.670245 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2e04c9cb-9b9f-4239-86d8-2de1eb4398fb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:39.829327 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:39.838813 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:39.845132 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:39.848504 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9e6704d1-3364-4ce7-b98e-3bc46e1eaaf0 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.493676 Aug 24 16:45:39.852353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 330/652] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:39 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:39.868448 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1d779231-1a25-4004-add9-a00390a737e5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:39.869470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1d779231-1a25-4004-add9-a00390a737e5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:39.883498 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d779231-1a25-4004-add9-a00390a737e5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:39.884525 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d779231-1a25-4004-add9-a00390a737e5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:39.890277 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d779231-1a25-4004-add9-a00390a737e5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:39.892102 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d779231-1a25-4004-add9-a00390a737e5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:39.892814 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d779231-1a25-4004-add9-a00390a737e5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:39.893462 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1d779231-1a25-4004-add9-a00390a737e5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:40.141903 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2e04c9cb-9b9f-4239-86d8-2de1eb4398fb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:40.163464 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2e04c9cb-9b9f-4239-86d8-2de1eb4398fb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.510442 Aug 24 16:45:40.165118 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 323/653] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:39 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:40.201358 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1d779231-1a25-4004-add9-a00390a737e5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:40.214688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1d779231-1a25-4004-add9-a00390a737e5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1577 microversion: 2.1 time: 0.360461 Aug 24 16:45:40.233690 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 331/654] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:39 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1577 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:40.877192 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:40.878174 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:40.886416 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:40.886898 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:40.887541 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:40.888575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:40.889209 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:40.889840 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:41.152604 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:41.163529 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:41.166018 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:41.167211 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9456147e-c35c-4044-baf4-3f40e72b2c34 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.294276 Aug 24 16:45:41.167786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 324/655] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:40 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:41.189848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ab85f42e-3df9-42e8-8bc0-2193b921b5a3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:41.190654 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ab85f42e-3df9-42e8-8bc0-2193b921b5a3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:41.198099 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ab85f42e-3df9-42e8-8bc0-2193b921b5a3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:41.198596 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ab85f42e-3df9-42e8-8bc0-2193b921b5a3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:41.199061 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ab85f42e-3df9-42e8-8bc0-2193b921b5a3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:41.199770 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ab85f42e-3df9-42e8-8bc0-2193b921b5a3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:41.200363 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ab85f42e-3df9-42e8-8bc0-2193b921b5a3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:41.200787 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ab85f42e-3df9-42e8-8bc0-2193b921b5a3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:41.244072 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e0cd11b9-89b7-4581-b98c-d05f719b2981 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:41.244706 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e0cd11b9-89b7-4581-b98c-d05f719b2981 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:41.251877 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0cd11b9-89b7-4581-b98c-d05f719b2981 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:41.252415 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0cd11b9-89b7-4581-b98c-d05f719b2981 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:41.252858 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0cd11b9-89b7-4581-b98c-d05f719b2981 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:41.253619 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0cd11b9-89b7-4581-b98c-d05f719b2981 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:41.254151 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0cd11b9-89b7-4581-b98c-d05f719b2981 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:41.254618 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e0cd11b9-89b7-4581-b98c-d05f719b2981 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:41.495454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-ab85f42e-3df9-42e8-8bc0-2193b921b5a3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:41.506305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ab85f42e-3df9-42e8-8bc0-2193b921b5a3 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.321271 Aug 24 16:45:41.506900 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 332/656] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:41 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:41.528826 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e0cd11b9-89b7-4581-b98c-d05f719b2981 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:41.538126 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e0cd11b9-89b7-4581-b98c-d05f719b2981 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1577 microversion: 2.1 time: 0.297844 Aug 24 16:45:41.538841 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 325/657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:41 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1577 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:42.191276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:42.191916 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:42.198532 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:42.199020 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:42.199502 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:42.200247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:42.200733 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:42.201180 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:42.394644 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:42.407391 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:42.409471 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:42.410834 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9514f33e-4083-44f2-a9a5-bcded7f10b69 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.224239 Aug 24 16:45:42.411706 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 333/658] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:42 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:42.528409 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-45767679-cda7-43da-ba04-9b67d32375ab tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:42.529028 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-45767679-cda7-43da-ba04-9b67d32375ab tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:42.538867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45767679-cda7-43da-ba04-9b67d32375ab tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:42.543465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45767679-cda7-43da-ba04-9b67d32375ab tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:42.544163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45767679-cda7-43da-ba04-9b67d32375ab tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:42.545170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45767679-cda7-43da-ba04-9b67d32375ab tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:42.545788 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45767679-cda7-43da-ba04-9b67d32375ab tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:42.549499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45767679-cda7-43da-ba04-9b67d32375ab tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:42.560208 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d26c098c-b067-416f-a117-2820f4839595 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:42.560827 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d26c098c-b067-416f-a117-2820f4839595 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:42.577926 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d26c098c-b067-416f-a117-2820f4839595 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:42.578736 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d26c098c-b067-416f-a117-2820f4839595 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:42.579398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d26c098c-b067-416f-a117-2820f4839595 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:42.580510 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d26c098c-b067-416f-a117-2820f4839595 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:42.581185 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d26c098c-b067-416f-a117-2820f4839595 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:42.581779 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d26c098c-b067-416f-a117-2820f4839595 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:42.915590 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d26c098c-b067-416f-a117-2820f4839595 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:42.928365 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d26c098c-b067-416f-a117-2820f4839595 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1577 microversion: 2.1 time: 0.371967 Aug 24 16:45:42.929681 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 334/659] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:42 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1577 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:42.941273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-45767679-cda7-43da-ba04-9b67d32375ab tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:42.950371 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-45767679-cda7-43da-ba04-9b67d32375ab tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.426484 Aug 24 16:45:42.951324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 326/660] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:42 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:43.434677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:43.436033 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:43.443157 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:43.443906 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:43.444546 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:43.445520 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:43.446120 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:43.446691 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:43.950107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b25c45e0-be96-419d-9b09-b1f072f32701 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:43.950717 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b25c45e0-be96-419d-9b09-b1f072f32701 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:43.960553 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b25c45e0-be96-419d-9b09-b1f072f32701 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:43.974869 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b25c45e0-be96-419d-9b09-b1f072f32701 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:43.975631 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b25c45e0-be96-419d-9b09-b1f072f32701 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:43.976124 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b25c45e0-be96-419d-9b09-b1f072f32701 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:43.976585 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b25c45e0-be96-419d-9b09-b1f072f32701 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:43.984984 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b25c45e0-be96-419d-9b09-b1f072f32701 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:44.118106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:44.131931 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:44.138916 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:44.144626 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b4442008-f170-4b2f-afa9-1d73301b9477 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.711667 Aug 24 16:45:44.145676 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 335/661] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:43 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 16:45:44.167454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e08ad305-7744-40fb-a044-5bc913fbeb62 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:44.168516 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e08ad305-7744-40fb-a044-5bc913fbeb62 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:44.175471 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e08ad305-7744-40fb-a044-5bc913fbeb62 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:44.176506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e08ad305-7744-40fb-a044-5bc913fbeb62 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:44.177166 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e08ad305-7744-40fb-a044-5bc913fbeb62 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:44.178094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e08ad305-7744-40fb-a044-5bc913fbeb62 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:44.185759 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e08ad305-7744-40fb-a044-5bc913fbeb62 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:44.186388 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e08ad305-7744-40fb-a044-5bc913fbeb62 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:44.366247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b25c45e0-be96-419d-9b09-b1f072f32701 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:44.385190 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b25c45e0-be96-419d-9b09-b1f072f32701 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1577 microversion: 2.1 time: 0.438807 Aug 24 16:45:44.386069 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 327/662] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:43 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1577 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:44.495001 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e08ad305-7744-40fb-a044-5bc913fbeb62 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:44.504738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e08ad305-7744-40fb-a044-5bc913fbeb62 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.341870 Aug 24 16:45:44.505505 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 336/663] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:44 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:45.170837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:45.171447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:45.185409 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:45.185924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:45.186368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:45.187099 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:45.187566 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:45.188599 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:45.410343 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0d32af25-c4da-4910-8c9d-e60b64281c74 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:45.412928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0d32af25-c4da-4910-8c9d-e60b64281c74 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:45.419904 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0d32af25-c4da-4910-8c9d-e60b64281c74 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:45.420547 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0d32af25-c4da-4910-8c9d-e60b64281c74 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:45.421074 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0d32af25-c4da-4910-8c9d-e60b64281c74 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:45.421900 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0d32af25-c4da-4910-8c9d-e60b64281c74 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:45.423375 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0d32af25-c4da-4910-8c9d-e60b64281c74 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:45.424114 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0d32af25-c4da-4910-8c9d-e60b64281c74 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:45.543417 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:45.558807 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:45.574820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:45.581210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8a3385d2-498d-4c83-a60b-464b3b595c5a tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.410749 Aug 24 16:45:45.593111 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 328/664] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:45 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:45.612828 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-03772a68-97b5-4e6a-888b-7ab2f836c376 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:45.613453 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-03772a68-97b5-4e6a-888b-7ab2f836c376 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:45.633828 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03772a68-97b5-4e6a-888b-7ab2f836c376 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:45.634518 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03772a68-97b5-4e6a-888b-7ab2f836c376 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:45.634954 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03772a68-97b5-4e6a-888b-7ab2f836c376 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:45.635668 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03772a68-97b5-4e6a-888b-7ab2f836c376 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:45.636153 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03772a68-97b5-4e6a-888b-7ab2f836c376 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:45.636577 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-03772a68-97b5-4e6a-888b-7ab2f836c376 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:45.931975 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0d32af25-c4da-4910-8c9d-e60b64281c74 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:45.939555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0d32af25-c4da-4910-8c9d-e60b64281c74 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1577 microversion: 2.1 time: 0.533809 Aug 24 16:45:45.940491 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 337/665] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:45 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1577 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:46.103500 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-03772a68-97b5-4e6a-888b-7ab2f836c376 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:46.112455 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-03772a68-97b5-4e6a-888b-7ab2f836c376 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.514604 Aug 24 16:45:46.113028 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 329/666] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:45 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:46.605576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:46.606385 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:46.617431 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:46.622970 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:46.623529 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:46.624418 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:46.624994 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:46.626048 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:46.883325 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:46.893314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:46.919563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:46.921122 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d2b105f0-4bd1-4b5c-a16b-530b2ed8bdbb tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.319588 Aug 24 16:45:46.922475 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 338/667] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:46 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:46.962822 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-cfc99730-8177-4bfc-b235-f8d21c553596 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:46.965764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-cfc99730-8177-4bfc-b235-f8d21c553596 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:46.975208 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfc99730-8177-4bfc-b235-f8d21c553596 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:46.976531 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfc99730-8177-4bfc-b235-f8d21c553596 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:46.977485 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfc99730-8177-4bfc-b235-f8d21c553596 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:46.978750 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfc99730-8177-4bfc-b235-f8d21c553596 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:46.979434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfc99730-8177-4bfc-b235-f8d21c553596 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:46.980198 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cfc99730-8177-4bfc-b235-f8d21c553596 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:47.098784 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-cfc99730-8177-4bfc-b235-f8d21c553596 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:47.106859 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-cfc99730-8177-4bfc-b235-f8d21c553596 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 200 len: 1225 microversion: 2.1 time: 0.148736 Aug 24 16:45:47.108569 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 339/668] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:46 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 1225 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:47.133906 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-661d9ed1-7738-4f71-839b-7a251e62c0b5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:47.134810 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-661d9ed1-7738-4f71-839b-7a251e62c0b5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:47.141681 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-661d9ed1-7738-4f71-839b-7a251e62c0b5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.142584 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-661d9ed1-7738-4f71-839b-7a251e62c0b5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.143214 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-661d9ed1-7738-4f71-839b-7a251e62c0b5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:47.144150 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-661d9ed1-7738-4f71-839b-7a251e62c0b5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.144762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-661d9ed1-7738-4f71-839b-7a251e62c0b5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.145600 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-661d9ed1-7738-4f71-839b-7a251e62c0b5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:47.216094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-250a93fa-c78c-49aa-a592-16b0b1769bac req-ae3ea120-6504-4b54-8a43-784a21dd6cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ba5c9b-d3ec-4458-9ad3-eefdc9882599", "name": "network-vif-deleted", "tag": "7e3be820-ac99-48f6-a3cd-ea4af916ff3b"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:47.237626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-250a93fa-c78c-49aa-a592-16b0b1769bac req-ae3ea120-6504-4b54-8a43-784a21dd6cc1 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.240810 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-250a93fa-c78c-49aa-a592-16b0b1769bac req-ae3ea120-6504-4b54-8a43-784a21dd6cc1 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.241461 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-250a93fa-c78c-49aa-a592-16b0b1769bac req-ae3ea120-6504-4b54-8a43-784a21dd6cc1 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:47.273005 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-250a93fa-c78c-49aa-a592-16b0b1769bac req-ae3ea120-6504-4b54-8a43-784a21dd6cc1 service nova] Creating event network-vif-deleted:7e3be820-ac99-48f6-a3cd-ea4af916ff3b for instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 on hv-cinder-77957 Aug 24 16:45:47.285636 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-250a93fa-c78c-49aa-a592-16b0b1769bac req-ae3ea120-6504-4b54-8a43-784a21dd6cc1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.530578 Aug 24 16:45:47.286546 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 330/669] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:45:47.320706 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-661d9ed1-7738-4f71-839b-7a251e62c0b5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:47.332466 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-661d9ed1-7738-4f71-839b-7a251e62c0b5 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1508 microversion: 2.1 time: 0.202470 Aug 24 16:45:47.333380 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 340/670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:47 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:47.354160 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-855fe052-6d12-4db5-a5b0-8bc553410430 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:47.355118 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-855fe052-6d12-4db5-a5b0-8bc553410430 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:47.361574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-855fe052-6d12-4db5-a5b0-8bc553410430 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.362310 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-855fe052-6d12-4db5-a5b0-8bc553410430 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.363236 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-855fe052-6d12-4db5-a5b0-8bc553410430 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:47.364126 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-855fe052-6d12-4db5-a5b0-8bc553410430 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.364742 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-855fe052-6d12-4db5-a5b0-8bc553410430 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.365161 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-855fe052-6d12-4db5-a5b0-8bc553410430 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:47.413188 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-855fe052-6d12-4db5-a5b0-8bc553410430 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127165) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 16:45:47.543453 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-855fe052-6d12-4db5-a5b0-8bc553410430 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "POST /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db/action" status: 202 len: 0 microversion: 2.1 time: 0.192008 Aug 24 16:45:47.545443 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 331/671] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:45:47 2022] POST /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:45:47.558503 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-47b72407-f4ea-42fb-b0b3-ba3a34c8bac0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:47.559444 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-47b72407-f4ea-42fb-b0b3-ba3a34c8bac0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:47.569844 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47b72407-f4ea-42fb-b0b3-ba3a34c8bac0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.570702 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47b72407-f4ea-42fb-b0b3-ba3a34c8bac0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.571290 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47b72407-f4ea-42fb-b0b3-ba3a34c8bac0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:47.575290 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47b72407-f4ea-42fb-b0b3-ba3a34c8bac0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.576162 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47b72407-f4ea-42fb-b0b3-ba3a34c8bac0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.576751 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-47b72407-f4ea-42fb-b0b3-ba3a34c8bac0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:47.810749 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-47b72407-f4ea-42fb-b0b3-ba3a34c8bac0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:47.823871 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-47b72407-f4ea-42fb-b0b3-ba3a34c8bac0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1516 microversion: 2.1 time: 0.270992 Aug 24 16:45:47.824559 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 341/672] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:47 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1516 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:47.946643 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:47.947804 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:47.960440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.962293 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.967909 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:47.968889 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:47.969366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:47.969812 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:48.134199 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:48.135076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:48.145707 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:48.148642 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:48.149360 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:48.152931 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:48.155773 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:48.157048 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:48.209095 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] HTTP exception thrown: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Request method failure captured: Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 HTTP/1.1 Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlTz42ucFQOgcikyVSr4o5VXyZ_N2xwj4hT0vEl60zJ-iZcygcpxmXVbsYVLxSmRjbOWNvNyA3JrS70vIa5M74t7BkFCm_8eXVPYK3j6rlYy2PM2c319d1o7voVuJJWTwZw_SkEJ6FC-VhrIoosXEVvwY7hEuR278wcVBQrN8S3S514 Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 7c99de6ca9094fa7bd119a3be6817725 Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:45:48.217552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7c99de6ca9094fa7bd119a3be6817725", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 7c99de6ca9094fa7bd119a3be6817725 Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-TestVolumeBootPattern-1282274193-project Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: bb5d3834f04142e288c04cc05665329f Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-TestVolumeBootPattern-1282274193-project Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:45:48.219769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '03ba5c9b-d3ec-4458-9ad3-eefdc9882599'} Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:45:48.220776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:45:48.222533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:45:48.226111 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Returning 404 to user: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:45:48.227915 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7b25a244-18d5-456e-bc17-b6b469fd97e2 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 404 len: 111 microversion: 2.1 time: 0.098345 Aug 24 16:45:48.229412 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 342/673] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:48 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:45:48.249496 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:48.258362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:48.259997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:48.261216 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-baa0f9d7-f414-478d-b05c-4ffd31642f03 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.319665 Aug 24 16:45:48.263327 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 332/674] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:47 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:48.363023 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1866324281", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1832399109", "security_groups": [{"name": "tempest-secgroup-smoke-1681464898"}], "block_device_mapping_v2": [{"uuid": "a6296d00-db00-45b1-af04-7f43918e1c35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3e014ccf-9e98-4c79-acd6-45f0ecc3f7d2"}]}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:48.498036 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] validate_networks() for [('3e014ccf-9e98-4c79-acd6-45f0ecc3f7d2', None, None, None, None, None)] {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:45:48.850093 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-fb9fbc47-a203-4f65-ba21-58d6a295633d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:48.850798 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-fb9fbc47-a203-4f65-ba21-58d6a295633d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:48.862697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb9fbc47-a203-4f65-ba21-58d6a295633d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:48.863270 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb9fbc47-a203-4f65-ba21-58d6a295633d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:48.863717 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb9fbc47-a203-4f65-ba21-58d6a295633d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:48.879144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb9fbc47-a203-4f65-ba21-58d6a295633d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:48.879649 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb9fbc47-a203-4f65-ba21-58d6a295633d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:48.882805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb9fbc47-a203-4f65-ba21-58d6a295633d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:49.531103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-fb9fbc47-a203-4f65-ba21-58d6a295633d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:49.540418 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-fb9fbc47-a203-4f65-ba21-58d6a295633d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1516 microversion: 2.1 time: 0.697213 Aug 24 16:45:49.541386 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 333/675] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:48 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1516 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:49.546191 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-1be5f616-bf71-40e4-b9df-774103f4754c req-79e44116-014c-45ed-8b0a-ad39c3c77dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e451e3e-9a42-40af-aff5-e8f8938252db", "name": "network-vif-unplugged", "status": "completed", "tag": "bdb45216-e99f-41b9-b9d6-611a8882cee0"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:49.560725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-1be5f616-bf71-40e4-b9df-774103f4754c req-79e44116-014c-45ed-8b0a-ad39c3c77dad service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:49.561491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-1be5f616-bf71-40e4-b9df-774103f4754c req-79e44116-014c-45ed-8b0a-ad39c3c77dad service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:49.561924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-1be5f616-bf71-40e4-b9df-774103f4754c req-79e44116-014c-45ed-8b0a-ad39c3c77dad service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:49.575155 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.compute.server_external_events [req-1be5f616-bf71-40e4-b9df-774103f4754c req-79e44116-014c-45ed-8b0a-ad39c3c77dad service nova] Unable to find a host for instance 8e451e3e-9a42-40af-aff5-e8f8938252db. Dropping event network-vif-unplugged {{(pid=127165) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 16:45:49.576070 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-1be5f616-bf71-40e4-b9df-774103f4754c req-79e44116-014c-45ed-8b0a-ad39c3c77dad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033496 Aug 24 16:45:49.576854 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 334/676] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 16:45:49.582658 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:49.583490 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:49.590979 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:49.592454 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:49.593166 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:49.594412 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:49.594879 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:49.595309 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:49.652985 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:45:49.653532 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:45:49.654107 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:45:49.654574 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:45:49.655002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:45:49.668302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:49.669009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:49.669905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:49.676854 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:49.677627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:49.678384 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:49.687156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=100 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:49.701345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Getting quotas for project 7c99de6ca9094fa7bd119a3be6817725. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:45:49.706586 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Getting quotas for user bb5d3834f04142e288c04cc05665329f and project 7c99de6ca9094fa7bd119a3be6817725. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:45:49.801562 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:45:49.804232 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6296d00-db00-45b1-af04-7f43918e1c35',volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:45:49.842584 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:49.855847 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:49.858330 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:49.873196 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1e601ebd-1246-4c55-87f3-96e160a54046 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.295050 Aug 24 16:45:49.874850 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 335/677] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:49 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:50.005495 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3d72bce7-7ded-477c-9b24-99639199369a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.645986 Aug 24 16:45:50.014960 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 343/678] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:45:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:45:50.022403 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c0f8a5f2-4ccb-4d5b-8d6e-1cc8df64ce16 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:50.024775 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c0f8a5f2-4ccb-4d5b-8d6e-1cc8df64ce16 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:50.113829 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c0f8a5f2-4ccb-4d5b-8d6e-1cc8df64ce16 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:50.120927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c0f8a5f2-4ccb-4d5b-8d6e-1cc8df64ce16 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1095 microversion: 2.1 time: 0.104529 Aug 24 16:45:50.134746 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 336/679] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:50 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1095 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:50.565024 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dccf1740-417d-4ec5-aecb-51879d5d9fc7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:50.566272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-dccf1740-417d-4ec5-aecb-51879d5d9fc7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:50.575015 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dccf1740-417d-4ec5-aecb-51879d5d9fc7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:50.575502 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dccf1740-417d-4ec5-aecb-51879d5d9fc7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:50.589963 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dccf1740-417d-4ec5-aecb-51879d5d9fc7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:50.592457 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dccf1740-417d-4ec5-aecb-51879d5d9fc7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:50.593937 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dccf1740-417d-4ec5-aecb-51879d5d9fc7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:50.595722 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dccf1740-417d-4ec5-aecb-51879d5d9fc7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:50.910841 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:50.912469 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:50.921114 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:50.922739 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:50.923410 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:50.924471 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:50.925155 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:50.925799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:50.962444 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-dccf1740-417d-4ec5-aecb-51879d5d9fc7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:50.973373 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-dccf1740-417d-4ec5-aecb-51879d5d9fc7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.414019 Aug 24 16:45:50.973965 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 344/680] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:50 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:51.143060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5867052d-3c83-4d52-90d2-cc445850c4f7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:51.143767 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5867052d-3c83-4d52-90d2-cc445850c4f7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:51.151452 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5867052d-3c83-4d52-90d2-cc445850c4f7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:51.151966 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5867052d-3c83-4d52-90d2-cc445850c4f7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:51.157611 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5867052d-3c83-4d52-90d2-cc445850c4f7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:51.160416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5867052d-3c83-4d52-90d2-cc445850c4f7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:51.161446 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5867052d-3c83-4d52-90d2-cc445850c4f7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:51.161885 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5867052d-3c83-4d52-90d2-cc445850c4f7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:51.285123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5867052d-3c83-4d52-90d2-cc445850c4f7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:51.300784 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5867052d-3c83-4d52-90d2-cc445850c4f7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1193 microversion: 2.1 time: 0.162902 Aug 24 16:45:51.302141 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 345/681] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:51 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1193 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:51.374479 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:51.386319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:51.387827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:51.399430 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-feb2e11f-38d0-423a-9080-ab4b575850df tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.504087 Aug 24 16:45:51.420878 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 337/682] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:50 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:51.606236 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-4fe9d9c8-65a9-41ef-a35e-d4fbb3392232 req-a1024642-af50-4231-a366-be150ad50f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e736aeb-6bda-4b29-97e9-4f697ccdf966", "name": "network-vif-plugged", "status": "completed", "tag": "3cb1bcfc-1858-4dec-acc8-8e6b442af514"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:51.621517 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-4fe9d9c8-65a9-41ef-a35e-d4fbb3392232 req-a1024642-af50-4231-a366-be150ad50f48 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:51.622011 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-4fe9d9c8-65a9-41ef-a35e-d4fbb3392232 req-a1024642-af50-4231-a366-be150ad50f48 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:51.622457 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-4fe9d9c8-65a9-41ef-a35e-d4fbb3392232 req-a1024642-af50-4231-a366-be150ad50f48 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:51.646176 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-4fe9d9c8-65a9-41ef-a35e-d4fbb3392232 req-a1024642-af50-4231-a366-be150ad50f48 service nova] Creating event network-vif-plugged:3cb1bcfc-1858-4dec-acc8-8e6b442af514 for instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 on hv-cinder-77957 Aug 24 16:45:51.651693 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-4fe9d9c8-65a9-41ef-a35e-d4fbb3392232 req-a1024642-af50-4231-a366-be150ad50f48 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049281 Aug 24 16:45:51.652337 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 346/683] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:52.024189 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f2711e50-3479-4156-bf83-666fe66d2a67 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:52.025080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f2711e50-3479-4156-bf83-666fe66d2a67 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:52.033861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f2711e50-3479-4156-bf83-666fe66d2a67 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:52.034691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f2711e50-3479-4156-bf83-666fe66d2a67 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:52.035514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f2711e50-3479-4156-bf83-666fe66d2a67 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:52.036542 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f2711e50-3479-4156-bf83-666fe66d2a67 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:52.037190 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f2711e50-3479-4156-bf83-666fe66d2a67 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:52.037766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f2711e50-3479-4156-bf83-666fe66d2a67 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:52.307899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-f2711e50-3479-4156-bf83-666fe66d2a67 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:52.320321 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f2711e50-3479-4156-bf83-666fe66d2a67 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.300740 Aug 24 16:45:52.323000 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 338/684] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:52 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:52.335962 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-504be473-c383-48b5-b11a-ed9a0253248c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:52.337339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-504be473-c383-48b5-b11a-ed9a0253248c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:52.351494 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-504be473-c383-48b5-b11a-ed9a0253248c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:52.352314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-504be473-c383-48b5-b11a-ed9a0253248c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:52.352938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-504be473-c383-48b5-b11a-ed9a0253248c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:52.353839 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-504be473-c383-48b5-b11a-ed9a0253248c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:52.354450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-504be473-c383-48b5-b11a-ed9a0253248c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:52.355031 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-504be473-c383-48b5-b11a-ed9a0253248c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:52.429226 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:52.430230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:52.442312 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-504be473-c383-48b5-b11a-ed9a0253248c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:52.443152 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:52.443973 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:52.444890 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:52.446046 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:52.448113 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:52.448767 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:52.450945 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-504be473-c383-48b5-b11a-ed9a0253248c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1211 microversion: 2.1 time: 0.132197 Aug 24 16:45:52.452611 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 347/685] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:52 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1211 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:52.476585 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:52.657135 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:52.674948 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:52.677419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:52.679025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-43275a3a-9923-47e2-839e-3fefa697fbf1 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.254209 Aug 24 16:45:52.692932 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 339/686] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:52 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:53.347731 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5a2e7010-3ead-4bb1-98bc-92ed700951ed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:53.351105 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5a2e7010-3ead-4bb1-98bc-92ed700951ed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:53.361302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5a2e7010-3ead-4bb1-98bc-92ed700951ed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:53.362211 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5a2e7010-3ead-4bb1-98bc-92ed700951ed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:53.362865 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5a2e7010-3ead-4bb1-98bc-92ed700951ed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:53.364060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5a2e7010-3ead-4bb1-98bc-92ed700951ed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:53.364733 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5a2e7010-3ead-4bb1-98bc-92ed700951ed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:53.365559 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5a2e7010-3ead-4bb1-98bc-92ed700951ed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:53.478018 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-43d8b224-eed2-48dd-a951-60652b1dc472 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:53.478668 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-43d8b224-eed2-48dd-a951-60652b1dc472 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:53.493262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43d8b224-eed2-48dd-a951-60652b1dc472 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:53.494005 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43d8b224-eed2-48dd-a951-60652b1dc472 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:53.494618 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43d8b224-eed2-48dd-a951-60652b1dc472 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:53.497442 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43d8b224-eed2-48dd-a951-60652b1dc472 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:53.498130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43d8b224-eed2-48dd-a951-60652b1dc472 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:53.498761 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-43d8b224-eed2-48dd-a951-60652b1dc472 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:53.854624 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5a2e7010-3ead-4bb1-98bc-92ed700951ed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:53.869613 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5a2e7010-3ead-4bb1-98bc-92ed700951ed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.530898 Aug 24 16:45:53.870814 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 348/687] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:53 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:53.893891 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:53.894741 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:53.905376 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:53.909348 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:53.910007 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:53.910935 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:53.914561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:53.915896 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:53.944607 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-43d8b224-eed2-48dd-a951-60652b1dc472 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:53.958021 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-43d8b224-eed2-48dd-a951-60652b1dc472 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.488775 Aug 24 16:45:53.959215 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 340/688] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:53 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:54.235917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:54.250665 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:54.264420 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:54.267848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b2fda96f-094f-410a-8842-3520760788f4 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1730 microversion: 2.20 time: 0.395912 Aug 24 16:45:54.268927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 349/689] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:53 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1730 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:54.284568 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-152d3aaf-d91b-4c95-80e2-04025315134d req-9ca365db-49ae-4165-adb4-6ffabfb36739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c16b9f1-a570-4574-9f31-55ee4d2c0345", "tag": "08e2ad33-cf8e-48c5-af02-bfc6e0668156"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:45:54.296258 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-152d3aaf-d91b-4c95-80e2-04025315134d req-9ca365db-49ae-4165-adb4-6ffabfb36739 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:54.297357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-152d3aaf-d91b-4c95-80e2-04025315134d req-9ca365db-49ae-4165-adb4-6ffabfb36739 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:54.300065 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-152d3aaf-d91b-4c95-80e2-04025315134d req-9ca365db-49ae-4165-adb4-6ffabfb36739 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:54.321939 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-152d3aaf-d91b-4c95-80e2-04025315134d req-9ca365db-49ae-4165-adb4-6ffabfb36739 service nova] Creating event network-changed:08e2ad33-cf8e-48c5-af02-bfc6e0668156 for instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 on hv-cinder-77957 Aug 24 16:45:54.330795 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-152d3aaf-d91b-4c95-80e2-04025315134d req-9ca365db-49ae-4165-adb4-6ffabfb36739 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058820 Aug 24 16:45:54.331565 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 341/690] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:45:54.900604 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fbadbc57-2d65-4993-8df1-bfdf0d3ef2cb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:54.901219 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fbadbc57-2d65-4993-8df1-bfdf0d3ef2cb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:54.923042 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbadbc57-2d65-4993-8df1-bfdf0d3ef2cb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:54.924122 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbadbc57-2d65-4993-8df1-bfdf0d3ef2cb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:54.924831 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbadbc57-2d65-4993-8df1-bfdf0d3ef2cb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:54.925858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbadbc57-2d65-4993-8df1-bfdf0d3ef2cb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:54.927226 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbadbc57-2d65-4993-8df1-bfdf0d3ef2cb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:54.927910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fbadbc57-2d65-4993-8df1-bfdf0d3ef2cb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:54.983235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9529d90a-6e6a-444a-8399-44010efe9258 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:54.985262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9529d90a-6e6a-444a-8399-44010efe9258 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:54.998347 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9529d90a-6e6a-444a-8399-44010efe9258 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:54.999292 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9529d90a-6e6a-444a-8399-44010efe9258 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:55.000233 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9529d90a-6e6a-444a-8399-44010efe9258 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:55.002176 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9529d90a-6e6a-444a-8399-44010efe9258 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:55.007919 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9529d90a-6e6a-444a-8399-44010efe9258 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:55.008723 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9529d90a-6e6a-444a-8399-44010efe9258 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:55.194004 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fbadbc57-2d65-4993-8df1-bfdf0d3ef2cb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:55.207234 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-fbadbc57-2d65-4993-8df1-bfdf0d3ef2cb tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.313319 Aug 24 16:45:55.208137 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 350/691] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:54 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:55.260956 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9529d90a-6e6a-444a-8399-44010efe9258 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:55.272532 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9529d90a-6e6a-444a-8399-44010efe9258 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.294606 Aug 24 16:45:55.284619 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 342/692] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:54 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:55.294978 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:55.296145 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:55.304184 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:55.310815 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:55.311756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:55.316622 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:55.317603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:55.318332 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:55.498527 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:55.517472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:55.519338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:55.524741 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c67d70b8-70b9-4c5f-8ce4-de6716bc325d tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1717 microversion: 2.20 time: 0.233827 Aug 24 16:45:55.525468 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 351/693] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:45:55 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1717 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:45:56.228594 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-cdd09b87-61e6-425c-969c-3622723afa28 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:56.229321 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-cdd09b87-61e6-425c-969c-3622723afa28 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:56.236078 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cdd09b87-61e6-425c-969c-3622723afa28 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:56.236557 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cdd09b87-61e6-425c-969c-3622723afa28 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:56.237209 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cdd09b87-61e6-425c-969c-3622723afa28 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:56.238072 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cdd09b87-61e6-425c-969c-3622723afa28 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:56.238736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cdd09b87-61e6-425c-969c-3622723afa28 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:56.239401 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cdd09b87-61e6-425c-969c-3622723afa28 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:56.296454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-17a92cf5-0900-4e25-95a4-bb033a240d29 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:56.297882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-17a92cf5-0900-4e25-95a4-bb033a240d29 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:56.304340 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-17a92cf5-0900-4e25-95a4-bb033a240d29 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:56.305143 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-17a92cf5-0900-4e25-95a4-bb033a240d29 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:56.305829 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-17a92cf5-0900-4e25-95a4-bb033a240d29 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:56.306762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-17a92cf5-0900-4e25-95a4-bb033a240d29 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:56.307290 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-17a92cf5-0900-4e25-95a4-bb033a240d29 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:56.307792 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-17a92cf5-0900-4e25-95a4-bb033a240d29 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:56.439683 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-cdd09b87-61e6-425c-969c-3622723afa28 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:56.448894 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-cdd09b87-61e6-425c-969c-3622723afa28 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.224227 Aug 24 16:45:56.449968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 343/694] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:56 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:56.503533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-17a92cf5-0900-4e25-95a4-bb033a240d29 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:56.512352 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-17a92cf5-0900-4e25-95a4-bb033a240d29 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.219710 Aug 24 16:45:56.516001 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 352/695] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:56 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:45:57.472884 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ba86c393-ba6a-4f55-b282-832ead588b6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:57.474380 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ba86c393-ba6a-4f55-b282-832ead588b6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:57.480607 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba86c393-ba6a-4f55-b282-832ead588b6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:57.481287 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba86c393-ba6a-4f55-b282-832ead588b6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:57.482012 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba86c393-ba6a-4f55-b282-832ead588b6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:57.482820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba86c393-ba6a-4f55-b282-832ead588b6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:57.483275 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba86c393-ba6a-4f55-b282-832ead588b6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:57.483696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba86c393-ba6a-4f55-b282-832ead588b6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:57.535818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-86dac412-f365-488d-a4ed-f5444677bdce tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:57.536475 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-86dac412-f365-488d-a4ed-f5444677bdce tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:57.546920 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86dac412-f365-488d-a4ed-f5444677bdce tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:57.547447 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86dac412-f365-488d-a4ed-f5444677bdce tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:57.547981 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86dac412-f365-488d-a4ed-f5444677bdce tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:57.548724 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86dac412-f365-488d-a4ed-f5444677bdce tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:57.549193 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86dac412-f365-488d-a4ed-f5444677bdce tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:57.549758 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-86dac412-f365-488d-a4ed-f5444677bdce tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:57.708743 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ba86c393-ba6a-4f55-b282-832ead588b6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:57.722299 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ba86c393-ba6a-4f55-b282-832ead588b6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.254979 Aug 24 16:45:57.723114 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 344/696] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:57 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:57.752914 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-86dac412-f365-488d-a4ed-f5444677bdce tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:57.760563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-86dac412-f365-488d-a4ed-f5444677bdce tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.229742 Aug 24 16:45:57.761147 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 353/697] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:57 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:58.746158 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-326d27ac-08cc-45fa-a568-588c56cb2c4b tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:58.747426 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-326d27ac-08cc-45fa-a568-588c56cb2c4b tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:58.751024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:58.755859 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-326d27ac-08cc-45fa-a568-588c56cb2c4b tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:58.756609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-326d27ac-08cc-45fa-a568-588c56cb2c4b tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:58.757048 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-326d27ac-08cc-45fa-a568-588c56cb2c4b tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:58.757754 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-326d27ac-08cc-45fa-a568-588c56cb2c4b tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:58.758218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-326d27ac-08cc-45fa-a568-588c56cb2c4b tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:58.758645 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-326d27ac-08cc-45fa-a568-588c56cb2c4b tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:58.784132 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f3385355-7fa5-4fbd-a750-1981ff0c6352 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:45:58.785449 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f3385355-7fa5-4fbd-a750-1981ff0c6352 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:45:58.791818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:58.793964 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f3385355-7fa5-4fbd-a750-1981ff0c6352 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:58.795475 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f3385355-7fa5-4fbd-a750-1981ff0c6352 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:58.796424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f3385355-7fa5-4fbd-a750-1981ff0c6352 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:58.797644 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f3385355-7fa5-4fbd-a750-1981ff0c6352 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:45:58.798247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f3385355-7fa5-4fbd-a750-1981ff0c6352 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:45:58.798806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f3385355-7fa5-4fbd-a750-1981ff0c6352 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:45:58.979515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-326d27ac-08cc-45fa-a568-588c56cb2c4b tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:58.992381 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-326d27ac-08cc-45fa-a568-588c56cb2c4b tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.250858 Aug 24 16:45:58.996273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 345/698] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:58 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:45:59.013843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f3385355-7fa5-4fbd-a750-1981ff0c6352 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:45:59.023299 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f3385355-7fa5-4fbd-a750-1981ff0c6352 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.245193 Aug 24 16:45:59.023872 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 354/699] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:45:58 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:00.020271 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d711a2fa-9b0a-40a9-951f-ac828b2ca1ca tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:00.020806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d711a2fa-9b0a-40a9-951f-ac828b2ca1ca tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:00.027265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d711a2fa-9b0a-40a9-951f-ac828b2ca1ca tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:00.027751 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d711a2fa-9b0a-40a9-951f-ac828b2ca1ca tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:00.028497 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d711a2fa-9b0a-40a9-951f-ac828b2ca1ca tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:00.029423 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d711a2fa-9b0a-40a9-951f-ac828b2ca1ca tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:00.030096 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d711a2fa-9b0a-40a9-951f-ac828b2ca1ca tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:00.030766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d711a2fa-9b0a-40a9-951f-ac828b2ca1ca tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:00.045447 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2bcc5437-2b5d-4531-a29d-d3c98ccbb0bf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:00.047254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2bcc5437-2b5d-4531-a29d-d3c98ccbb0bf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:00.050200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:00.058099 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=6 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:00.063694 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2bcc5437-2b5d-4531-a29d-d3c98ccbb0bf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:00.064343 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2bcc5437-2b5d-4531-a29d-d3c98ccbb0bf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:00.064685 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2bcc5437-2b5d-4531-a29d-d3c98ccbb0bf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:00.065406 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2bcc5437-2b5d-4531-a29d-d3c98ccbb0bf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:00.065883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2bcc5437-2b5d-4531-a29d-d3c98ccbb0bf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:00.066287 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2bcc5437-2b5d-4531-a29d-d3c98ccbb0bf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:00.118564 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:00.292500 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d711a2fa-9b0a-40a9-951f-ac828b2ca1ca tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:00.298257 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d711a2fa-9b0a-40a9-951f-ac828b2ca1ca tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.283450 Aug 24 16:46:00.299104 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 346/700] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:00 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:00.309288 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2bcc5437-2b5d-4531-a29d-d3c98ccbb0bf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:00.334378 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2bcc5437-2b5d-4531-a29d-d3c98ccbb0bf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.292559 Aug 24 16:46:00.335294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 355/701] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:00 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:00.887762 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1e74fd7d-3a7b-43e1-9466-0cf50fa6b4ee tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Action: 'create', calling method: .version_select at 0x7f063ab91040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1791929583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFcf+wjdyxGKf/BxJRF3Gxo29uHAO2MntR36Gs7iPWcqI8BPPq91bmTfDcafISAbg3JCfeTrWMk5v8AerkbMieUahflzn8eg0hYwMyEDwib0xb0o3THR/Oy2BwfBccVYA=="}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:00.903892 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-1e74fd7d-3a7b-43e1-9466-0cf50fa6b4ee tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Getting quotas for project 00a45ba3e79b425493703f960803cea1. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:00.909100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-1e74fd7d-3a7b-43e1-9466-0cf50fa6b4ee tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Getting quotas for user 623e7860c4ee4918b7a917024d35e39b and project 00a45ba3e79b425493703f960803cea1. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:00.932125 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1e74fd7d-3a7b-43e1-9466-0cf50fa6b4ee tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048054 Aug 24 16:46:00.932876 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 347/702] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 16:46:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:01.048651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-701577255", "imageRef": "a7f6b5bc-2f2d-4f8b-aef7-dd0fcb204973", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1791929583", "networks": [{"uuid": "795eba50-f357-4df1-921f-f77120b48e89"}]}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:01.101540 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] validate_networks() for [('795eba50-f357-4df1-921f-f77120b48e89', None, None, None, None, None)] {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:46:01.321454 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1c69c680-f74b-4128-802d-ec0b2a351aed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:01.321976 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1c69c680-f74b-4128-802d-ec0b2a351aed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:01.328436 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c69c680-f74b-4128-802d-ec0b2a351aed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:01.328761 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c69c680-f74b-4128-802d-ec0b2a351aed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:01.329192 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c69c680-f74b-4128-802d-ec0b2a351aed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:01.329884 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c69c680-f74b-4128-802d-ec0b2a351aed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:01.330334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c69c680-f74b-4128-802d-ec0b2a351aed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:01.330759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c69c680-f74b-4128-802d-ec0b2a351aed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:01.534901 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1c69c680-f74b-4128-802d-ec0b2a351aed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:01.542556 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1c69c680-f74b-4128-802d-ec0b2a351aed tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.225684 Aug 24 16:46:01.543126 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 348/703] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:01 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:01.548387 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-42a1b3a3-00d6-4250-a0b4-65eaf5132a33 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:01.548994 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-42a1b3a3-00d6-4250-a0b4-65eaf5132a33 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:01.550648 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:46:01.551210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:46:01.551696 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:46:01.552140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:46:01.552551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:46:01.555059 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-42a1b3a3-00d6-4250-a0b4-65eaf5132a33 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:01.555609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-42a1b3a3-00d6-4250-a0b4-65eaf5132a33 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:01.556231 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-42a1b3a3-00d6-4250-a0b4-65eaf5132a33 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:01.556985 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-42a1b3a3-00d6-4250-a0b4-65eaf5132a33 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:01.557515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-42a1b3a3-00d6-4250-a0b4-65eaf5132a33 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:01.558006 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-42a1b3a3-00d6-4250-a0b4-65eaf5132a33 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:01.561566 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:01.562090 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:01.562538 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:01.563269 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:01.563723 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:01.564197 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:01.581413 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Getting quotas for project 00a45ba3e79b425493703f960803cea1. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:01.585331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Getting quotas for user 623e7860c4ee4918b7a917024d35e39b and project 00a45ba3e79b425493703f960803cea1. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:01.597069 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:46:01.599467 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a7f6b5bc-2f2d-4f8b-aef7-dd0fcb204973',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:46:01.648063 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-25494a86-4080-43d8-99a5-f7ca2f898529 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604063 Aug 24 16:46:01.654152 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 356/704] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:46:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:46:01.659616 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8dec0f81-87d1-4fbd-b0e2-2aadc93c9872 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:01.660358 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8dec0f81-87d1-4fbd-b0e2-2aadc93c9872 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:01.708134 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-42a1b3a3-00d6-4250-a0b4-65eaf5132a33 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:01.715771 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-42a1b3a3-00d6-4250-a0b4-65eaf5132a33 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.171687 Aug 24 16:46:01.716371 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 349/705] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:01 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:01.725487 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8dec0f81-87d1-4fbd-b0e2-2aadc93c9872 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:01.734024 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8dec0f81-87d1-4fbd-b0e2-2aadc93c9872 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1258 microversion: 2.1 time: 0.078594 Aug 24 16:46:01.734800 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 357/706] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:01 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:02.566386 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8fe7d7ad-dbaa-46b5-a0ae-f61f24c31a64 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:02.566999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8fe7d7ad-dbaa-46b5-a0ae-f61f24c31a64 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:02.573343 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8fe7d7ad-dbaa-46b5-a0ae-f61f24c31a64 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.573835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8fe7d7ad-dbaa-46b5-a0ae-f61f24c31a64 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.574270 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8fe7d7ad-dbaa-46b5-a0ae-f61f24c31a64 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.574973 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8fe7d7ad-dbaa-46b5-a0ae-f61f24c31a64 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.575610 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8fe7d7ad-dbaa-46b5-a0ae-f61f24c31a64 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.576371 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8fe7d7ad-dbaa-46b5-a0ae-f61f24c31a64 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.706360 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-cd463179-3ebe-40fc-8945-d4b7855af22f req-6ed2a55c-f561-416b-b5c9-4e3fb2d9fca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e451e3e-9a42-40af-aff5-e8f8938252db", "name": "network-vif-plugged", "status": "completed", "tag": "bdb45216-e99f-41b9-b9d6-611a8882cee0"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:02.726512 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-cd463179-3ebe-40fc-8945-d4b7855af22f req-6ed2a55c-f561-416b-b5c9-4e3fb2d9fca7 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.733086 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-cd463179-3ebe-40fc-8945-d4b7855af22f req-6ed2a55c-f561-416b-b5c9-4e3fb2d9fca7 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.733086 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-cd463179-3ebe-40fc-8945-d4b7855af22f req-6ed2a55c-f561-416b-b5c9-4e3fb2d9fca7 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.743845 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8fe7d7ad-dbaa-46b5-a0ae-f61f24c31a64 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:02.756810 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-cd463179-3ebe-40fc-8945-d4b7855af22f req-6ed2a55c-f561-416b-b5c9-4e3fb2d9fca7 service nova] Creating event network-vif-plugged:bdb45216-e99f-41b9-b9d6-611a8882cee0 for instance 8e451e3e-9a42-40af-aff5-e8f8938252db on hv-cinder-77957 Aug 24 16:46:02.762256 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-cd463179-3ebe-40fc-8945-d4b7855af22f req-6ed2a55c-f561-416b-b5c9-4e3fb2d9fca7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062091 Aug 24 16:46:02.763436 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 358/707] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:02.769499 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c6b85e66-8b88-40aa-99a9-3482dc594a5c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:02.770445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c6b85e66-8b88-40aa-99a9-3482dc594a5c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:02.773926 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8fe7d7ad-dbaa-46b5-a0ae-f61f24c31a64 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.210709 Aug 24 16:46:02.776633 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 350/708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:02 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:02.791515 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6b85e66-8b88-40aa-99a9-3482dc594a5c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.792484 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6b85e66-8b88-40aa-99a9-3482dc594a5c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.793159 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6b85e66-8b88-40aa-99a9-3482dc594a5c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.794106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6b85e66-8b88-40aa-99a9-3482dc594a5c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.794578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6b85e66-8b88-40aa-99a9-3482dc594a5c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.795013 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6b85e66-8b88-40aa-99a9-3482dc594a5c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.804399 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-79562131-68d5-401a-8bd4-04903c5ba8fd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:02.805084 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-79562131-68d5-401a-8bd4-04903c5ba8fd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:02.820323 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-79562131-68d5-401a-8bd4-04903c5ba8fd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.821300 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-79562131-68d5-401a-8bd4-04903c5ba8fd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.822587 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-79562131-68d5-401a-8bd4-04903c5ba8fd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.823576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-79562131-68d5-401a-8bd4-04903c5ba8fd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:02.824310 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-79562131-68d5-401a-8bd4-04903c5ba8fd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:02.825462 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-79562131-68d5-401a-8bd4-04903c5ba8fd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:02.965562 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-79562131-68d5-401a-8bd4-04903c5ba8fd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:02.975138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-79562131-68d5-401a-8bd4-04903c5ba8fd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1328 microversion: 2.1 time: 0.197438 Aug 24 16:46:02.975788 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 351/709] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:02 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:03.016884 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c6b85e66-8b88-40aa-99a9-3482dc594a5c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:03.039056 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c6b85e66-8b88-40aa-99a9-3482dc594a5c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.273950 Aug 24 16:46:03.039667 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 359/710] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:02 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:03.800066 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-88719464-cf28-4db1-885f-308d0fcf45f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:03.800692 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-88719464-cf28-4db1-885f-308d0fcf45f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:03.807846 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88719464-cf28-4db1-885f-308d0fcf45f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:03.808372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88719464-cf28-4db1-885f-308d0fcf45f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:03.808811 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88719464-cf28-4db1-885f-308d0fcf45f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:03.809516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88719464-cf28-4db1-885f-308d0fcf45f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:03.809975 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88719464-cf28-4db1-885f-308d0fcf45f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:03.810510 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-88719464-cf28-4db1-885f-308d0fcf45f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:03.967828 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-88719464-cf28-4db1-885f-308d0fcf45f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:03.976809 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-88719464-cf28-4db1-885f-308d0fcf45f6 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.181825 Aug 24 16:46:03.991177 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 352/711] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:03 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:03.996866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-376487b6-bb67-4ca5-8d2f-5b29aa71e23d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:03.998105 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-376487b6-bb67-4ca5-8d2f-5b29aa71e23d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:04.005623 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-376487b6-bb67-4ca5-8d2f-5b29aa71e23d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:04.006122 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-376487b6-bb67-4ca5-8d2f-5b29aa71e23d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:04.006560 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-376487b6-bb67-4ca5-8d2f-5b29aa71e23d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:04.007265 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-376487b6-bb67-4ca5-8d2f-5b29aa71e23d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:04.007719 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-376487b6-bb67-4ca5-8d2f-5b29aa71e23d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:04.008186 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-376487b6-bb67-4ca5-8d2f-5b29aa71e23d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:04.063621 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-66f444eb-e41a-4e46-9fd7-c4b954d932ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:04.064257 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-66f444eb-e41a-4e46-9fd7-c4b954d932ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:04.071450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66f444eb-e41a-4e46-9fd7-c4b954d932ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:04.071968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66f444eb-e41a-4e46-9fd7-c4b954d932ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:04.072410 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66f444eb-e41a-4e46-9fd7-c4b954d932ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:04.073307 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66f444eb-e41a-4e46-9fd7-c4b954d932ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:04.073903 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66f444eb-e41a-4e46-9fd7-c4b954d932ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:04.074514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-66f444eb-e41a-4e46-9fd7-c4b954d932ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:04.229491 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-376487b6-bb67-4ca5-8d2f-5b29aa71e23d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:04.240506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-376487b6-bb67-4ca5-8d2f-5b29aa71e23d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.247324 Aug 24 16:46:04.255980 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 360/712] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:03 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:04.284175 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-66f444eb-e41a-4e46-9fd7-c4b954d932ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:04.292497 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-66f444eb-e41a-4e46-9fd7-c4b954d932ef tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.233516 Aug 24 16:46:04.293511 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 353/713] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:04 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:04.789318 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-14c27fa2-32a6-4c54-99b0-80813b6e365f req-0a51443f-b933-4da2-885c-99734b3e81ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c16b9f1-a570-4574-9f31-55ee4d2c0345", "name": "network-vif-plugged", "status": "completed", "tag": "08e2ad33-cf8e-48c5-af02-bfc6e0668156"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:04.798989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-14c27fa2-32a6-4c54-99b0-80813b6e365f req-0a51443f-b933-4da2-885c-99734b3e81ea service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:04.799358 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-14c27fa2-32a6-4c54-99b0-80813b6e365f req-0a51443f-b933-4da2-885c-99734b3e81ea service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:04.799788 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-14c27fa2-32a6-4c54-99b0-80813b6e365f req-0a51443f-b933-4da2-885c-99734b3e81ea service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:04.811527 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-14c27fa2-32a6-4c54-99b0-80813b6e365f req-0a51443f-b933-4da2-885c-99734b3e81ea service nova] Creating event network-vif-plugged:08e2ad33-cf8e-48c5-af02-bfc6e0668156 for instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 on hv-cinder-77957 Aug 24 16:46:04.816968 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-14c27fa2-32a6-4c54-99b0-80813b6e365f req-0a51443f-b933-4da2-885c-99734b3e81ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031318 Aug 24 16:46:04.817673 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 361/714] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:04.998107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4335af8a-7078-41c7-9eeb-f3e1f702e3e9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:04.998705 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4335af8a-7078-41c7-9eeb-f3e1f702e3e9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:05.005914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4335af8a-7078-41c7-9eeb-f3e1f702e3e9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.006406 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4335af8a-7078-41c7-9eeb-f3e1f702e3e9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.006825 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4335af8a-7078-41c7-9eeb-f3e1f702e3e9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:05.007519 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4335af8a-7078-41c7-9eeb-f3e1f702e3e9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.009169 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4335af8a-7078-41c7-9eeb-f3e1f702e3e9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.009169 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4335af8a-7078-41c7-9eeb-f3e1f702e3e9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:05.178637 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4335af8a-7078-41c7-9eeb-f3e1f702e3e9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:05.197230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4335af8a-7078-41c7-9eeb-f3e1f702e3e9 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.202846 Aug 24 16:46:05.197997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 354/715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:04 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:05.265751 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b5e25e9f-c3c5-4c45-9146-1eb6c78ab4a4 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:05.266704 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b5e25e9f-c3c5-4c45-9146-1eb6c78ab4a4 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:05.273264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b5e25e9f-c3c5-4c45-9146-1eb6c78ab4a4 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.273751 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b5e25e9f-c3c5-4c45-9146-1eb6c78ab4a4 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.274195 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b5e25e9f-c3c5-4c45-9146-1eb6c78ab4a4 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:05.275008 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b5e25e9f-c3c5-4c45-9146-1eb6c78ab4a4 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.275470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b5e25e9f-c3c5-4c45-9146-1eb6c78ab4a4 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.275896 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b5e25e9f-c3c5-4c45-9146-1eb6c78ab4a4 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:05.314130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d5508152-956a-4c06-b6be-6e30ebd4aa3e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:05.314729 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d5508152-956a-4c06-b6be-6e30ebd4aa3e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:05.321515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5508152-956a-4c06-b6be-6e30ebd4aa3e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.322021 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5508152-956a-4c06-b6be-6e30ebd4aa3e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.322497 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5508152-956a-4c06-b6be-6e30ebd4aa3e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:05.323204 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5508152-956a-4c06-b6be-6e30ebd4aa3e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:05.323648 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5508152-956a-4c06-b6be-6e30ebd4aa3e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:05.324206 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d5508152-956a-4c06-b6be-6e30ebd4aa3e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:05.496735 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b5e25e9f-c3c5-4c45-9146-1eb6c78ab4a4 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:05.511312 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b5e25e9f-c3c5-4c45-9146-1eb6c78ab4a4 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.251763 Aug 24 16:46:05.511910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 362/716] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:05 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:05.529170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d5508152-956a-4c06-b6be-6e30ebd4aa3e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:05.538484 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d5508152-956a-4c06-b6be-6e30ebd4aa3e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.228973 Aug 24 16:46:05.548836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 355/717] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:05 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:06.218647 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f8f5f217-b6d8-4cea-8b6c-997eecc1ad69 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:06.219391 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f8f5f217-b6d8-4cea-8b6c-997eecc1ad69 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:06.227935 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f5f217-b6d8-4cea-8b6c-997eecc1ad69 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:06.228478 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f5f217-b6d8-4cea-8b6c-997eecc1ad69 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:06.229113 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f5f217-b6d8-4cea-8b6c-997eecc1ad69 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:06.229910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f5f217-b6d8-4cea-8b6c-997eecc1ad69 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:06.230491 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f5f217-b6d8-4cea-8b6c-997eecc1ad69 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:06.230949 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8f5f217-b6d8-4cea-8b6c-997eecc1ad69 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:06.369558 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f8f5f217-b6d8-4cea-8b6c-997eecc1ad69 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:06.378197 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f8f5f217-b6d8-4cea-8b6c-997eecc1ad69 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.163399 Aug 24 16:46:06.378755 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 363/718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:06 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:06.535352 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9434b433-f022-43db-8b8e-0b2ed3579794 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:06.536020 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9434b433-f022-43db-8b8e-0b2ed3579794 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:06.542448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9434b433-f022-43db-8b8e-0b2ed3579794 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:06.542930 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9434b433-f022-43db-8b8e-0b2ed3579794 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:06.543358 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9434b433-f022-43db-8b8e-0b2ed3579794 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:06.544108 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9434b433-f022-43db-8b8e-0b2ed3579794 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:06.544559 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9434b433-f022-43db-8b8e-0b2ed3579794 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:06.545090 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9434b433-f022-43db-8b8e-0b2ed3579794 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:06.563903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f493c0e3-f0bb-48cc-85af-4290daeb99f0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:06.564821 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f493c0e3-f0bb-48cc-85af-4290daeb99f0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:06.576679 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f493c0e3-f0bb-48cc-85af-4290daeb99f0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:06.577353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f493c0e3-f0bb-48cc-85af-4290daeb99f0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:06.577812 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f493c0e3-f0bb-48cc-85af-4290daeb99f0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:06.578554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f493c0e3-f0bb-48cc-85af-4290daeb99f0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:06.579587 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f493c0e3-f0bb-48cc-85af-4290daeb99f0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:06.580158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f493c0e3-f0bb-48cc-85af-4290daeb99f0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:06.586386 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=100 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:06.742154 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9434b433-f022-43db-8b8e-0b2ed3579794 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:06.750485 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9434b433-f022-43db-8b8e-0b2ed3579794 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.220078 Aug 24 16:46:06.751625 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 356/719] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:06 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:06.771376 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f493c0e3-f0bb-48cc-85af-4290daeb99f0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:06.779014 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f493c0e3-f0bb-48cc-85af-4290daeb99f0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.219576 Aug 24 16:46:06.788169 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 364/720] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:06 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:07.400956 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e569829d-a687-4406-b80f-f3e8b22c6d6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:07.401538 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e569829d-a687-4406-b80f-f3e8b22c6d6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:07.409376 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e569829d-a687-4406-b80f-f3e8b22c6d6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:07.410286 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e569829d-a687-4406-b80f-f3e8b22c6d6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:07.410885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e569829d-a687-4406-b80f-f3e8b22c6d6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:07.411767 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e569829d-a687-4406-b80f-f3e8b22c6d6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:07.412406 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e569829d-a687-4406-b80f-f3e8b22c6d6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:07.412987 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e569829d-a687-4406-b80f-f3e8b22c6d6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:07.565582 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e569829d-a687-4406-b80f-f3e8b22c6d6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:07.568518 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=100 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:07.575508 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e569829d-a687-4406-b80f-f3e8b22c6d6d tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.178564 Aug 24 16:46:07.576205 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 357/721] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:07 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:07.772885 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-82df30f2-8946-414f-b089-cf600d6b7d5e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:07.773538 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-82df30f2-8946-414f-b089-cf600d6b7d5e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:07.779570 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82df30f2-8946-414f-b089-cf600d6b7d5e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:07.780106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82df30f2-8946-414f-b089-cf600d6b7d5e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:07.780564 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82df30f2-8946-414f-b089-cf600d6b7d5e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:07.781293 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82df30f2-8946-414f-b089-cf600d6b7d5e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:07.781740 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82df30f2-8946-414f-b089-cf600d6b7d5e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:07.782801 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-82df30f2-8946-414f-b089-cf600d6b7d5e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:07.805534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-014c0527-891d-448c-a23e-8721234ef193 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:07.807023 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-014c0527-891d-448c-a23e-8721234ef193 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:07.817830 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-014c0527-891d-448c-a23e-8721234ef193 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:07.819090 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-014c0527-891d-448c-a23e-8721234ef193 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:07.820169 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-014c0527-891d-448c-a23e-8721234ef193 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:07.821164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-014c0527-891d-448c-a23e-8721234ef193 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:07.821794 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-014c0527-891d-448c-a23e-8721234ef193 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:07.822585 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-014c0527-891d-448c-a23e-8721234ef193 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:07.996842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-82df30f2-8946-414f-b089-cf600d6b7d5e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:08.005400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-82df30f2-8946-414f-b089-cf600d6b7d5e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.236616 Aug 24 16:46:08.005982 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 365/722] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:07 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:08.024167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-014c0527-891d-448c-a23e-8721234ef193 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:08.033710 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-014c0527-891d-448c-a23e-8721234ef193 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.234920 Aug 24 16:46:08.037037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 358/723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:07 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:08.597454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3809ce1f-410e-4cad-aca9-cd56a9b4ecc8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:08.598059 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3809ce1f-410e-4cad-aca9-cd56a9b4ecc8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:08.603927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3809ce1f-410e-4cad-aca9-cd56a9b4ecc8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.604440 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3809ce1f-410e-4cad-aca9-cd56a9b4ecc8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.604878 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3809ce1f-410e-4cad-aca9-cd56a9b4ecc8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.605564 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3809ce1f-410e-4cad-aca9-cd56a9b4ecc8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:08.606017 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3809ce1f-410e-4cad-aca9-cd56a9b4ecc8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:08.606439 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3809ce1f-410e-4cad-aca9-cd56a9b4ecc8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:08.754119 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-3809ce1f-410e-4cad-aca9-cd56a9b4ecc8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:08.764770 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3809ce1f-410e-4cad-aca9-cd56a9b4ecc8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.171704 Aug 24 16:46:08.765516 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 366/724] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:08 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:09.037626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ea4df929-3bb6-4dad-bb3d-3e025c14e7f2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:09.037626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ea4df929-3bb6-4dad-bb3d-3e025c14e7f2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:09.043155 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea4df929-3bb6-4dad-bb3d-3e025c14e7f2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:09.043635 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea4df929-3bb6-4dad-bb3d-3e025c14e7f2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:09.044089 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea4df929-3bb6-4dad-bb3d-3e025c14e7f2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.044796 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea4df929-3bb6-4dad-bb3d-3e025c14e7f2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:09.045263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea4df929-3bb6-4dad-bb3d-3e025c14e7f2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:09.045676 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea4df929-3bb6-4dad-bb3d-3e025c14e7f2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.057290 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-727aa2b8-630c-41ed-a2ed-ff546ead9f31 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:09.057885 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-727aa2b8-630c-41ed-a2ed-ff546ead9f31 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:09.066924 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-727aa2b8-630c-41ed-a2ed-ff546ead9f31 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:09.067715 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-727aa2b8-630c-41ed-a2ed-ff546ead9f31 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:09.072077 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-727aa2b8-630c-41ed-a2ed-ff546ead9f31 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.073065 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-727aa2b8-630c-41ed-a2ed-ff546ead9f31 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:09.073720 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-727aa2b8-630c-41ed-a2ed-ff546ead9f31 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:09.074507 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-727aa2b8-630c-41ed-a2ed-ff546ead9f31 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.301094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ea4df929-3bb6-4dad-bb3d-3e025c14e7f2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:09.305180 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-727aa2b8-630c-41ed-a2ed-ff546ead9f31 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:09.314026 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-727aa2b8-630c-41ed-a2ed-ff546ead9f31 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.259902 Aug 24 16:46:09.314989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 367/725] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:09 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:09.315129 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ea4df929-3bb6-4dad-bb3d-3e025c14e7f2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.283279 Aug 24 16:46:09.315991 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 359/726] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:09 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:09.787336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9f17d7aa-8162-4879-9403-2f6d453334f8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:09.788041 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9f17d7aa-8162-4879-9403-2f6d453334f8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:09.794076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f17d7aa-8162-4879-9403-2f6d453334f8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:09.794563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f17d7aa-8162-4879-9403-2f6d453334f8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:09.794993 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f17d7aa-8162-4879-9403-2f6d453334f8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.795693 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f17d7aa-8162-4879-9403-2f6d453334f8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:09.796167 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f17d7aa-8162-4879-9403-2f6d453334f8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:09.796590 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9f17d7aa-8162-4879-9403-2f6d453334f8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:09.966628 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9f17d7aa-8162-4879-9403-2f6d453334f8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:09.980652 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9f17d7aa-8162-4879-9403-2f6d453334f8 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.193036 Aug 24 16:46:09.981545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 368/727] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:09 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:10.341446 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8a8d051c-dcd6-4e97-8f51-afb6a0a2233e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:10.342044 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8a8d051c-dcd6-4e97-8f51-afb6a0a2233e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:10.343735 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-44cd30ff-87f0-415f-93ee-bf36c27cfae3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:10.344476 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-44cd30ff-87f0-415f-93ee-bf36c27cfae3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:10.357177 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44cd30ff-87f0-415f-93ee-bf36c27cfae3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:10.357672 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44cd30ff-87f0-415f-93ee-bf36c27cfae3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:10.358578 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a8d051c-dcd6-4e97-8f51-afb6a0a2233e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:10.359232 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a8d051c-dcd6-4e97-8f51-afb6a0a2233e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:10.359656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a8d051c-dcd6-4e97-8f51-afb6a0a2233e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:10.360643 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a8d051c-dcd6-4e97-8f51-afb6a0a2233e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:10.361042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a8d051c-dcd6-4e97-8f51-afb6a0a2233e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:10.361474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a8d051c-dcd6-4e97-8f51-afb6a0a2233e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:10.366137 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44cd30ff-87f0-415f-93ee-bf36c27cfae3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:10.367240 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44cd30ff-87f0-415f-93ee-bf36c27cfae3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:10.367647 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44cd30ff-87f0-415f-93ee-bf36c27cfae3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:10.368009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-44cd30ff-87f0-415f-93ee-bf36c27cfae3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:10.581411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-44cd30ff-87f0-415f-93ee-bf36c27cfae3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:10.604780 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8a8d051c-dcd6-4e97-8f51-afb6a0a2233e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:10.605686 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-44cd30ff-87f0-415f-93ee-bf36c27cfae3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.272634 Aug 24 16:46:10.613331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 369/728] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:10 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:10.620140 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8a8d051c-dcd6-4e97-8f51-afb6a0a2233e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.285710 Aug 24 16:46:10.623987 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 360/729] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:10 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:11.008114 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b1f58eb4-7e6e-4f6b-a43c-9cb04c915c36 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:11.008655 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b1f58eb4-7e6e-4f6b-a43c-9cb04c915c36 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:11.014695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1f58eb4-7e6e-4f6b-a43c-9cb04c915c36 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:11.015190 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1f58eb4-7e6e-4f6b-a43c-9cb04c915c36 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:11.015626 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1f58eb4-7e6e-4f6b-a43c-9cb04c915c36 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:11.016892 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1f58eb4-7e6e-4f6b-a43c-9cb04c915c36 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:11.017548 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1f58eb4-7e6e-4f6b-a43c-9cb04c915c36 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:11.017990 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b1f58eb4-7e6e-4f6b-a43c-9cb04c915c36 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:11.162995 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b1f58eb4-7e6e-4f6b-a43c-9cb04c915c36 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:11.170898 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b1f58eb4-7e6e-4f6b-a43c-9cb04c915c36 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.172308 Aug 24 16:46:11.171471 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 370/730] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:10 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:11.625718 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b45e62f1-8b96-4e6a-b553-5a88e829af3d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:11.626350 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b45e62f1-8b96-4e6a-b553-5a88e829af3d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:11.628188 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=4 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:11.634241 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b45e62f1-8b96-4e6a-b553-5a88e829af3d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:11.634735 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b45e62f1-8b96-4e6a-b553-5a88e829af3d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:11.635171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b45e62f1-8b96-4e6a-b553-5a88e829af3d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:11.637532 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b45e62f1-8b96-4e6a-b553-5a88e829af3d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:11.637532 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b45e62f1-8b96-4e6a-b553-5a88e829af3d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:11.637532 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b45e62f1-8b96-4e6a-b553-5a88e829af3d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:11.644110 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5e8989d9-868a-4432-96e0-c46a5b307b24 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:11.644973 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5e8989d9-868a-4432-96e0-c46a5b307b24 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:11.646790 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:11.652276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e8989d9-868a-4432-96e0-c46a5b307b24 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:11.652761 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e8989d9-868a-4432-96e0-c46a5b307b24 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:11.653196 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e8989d9-868a-4432-96e0-c46a5b307b24 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:11.653880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e8989d9-868a-4432-96e0-c46a5b307b24 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:11.654328 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e8989d9-868a-4432-96e0-c46a5b307b24 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:11.654743 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5e8989d9-868a-4432-96e0-c46a5b307b24 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:11.731558 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=8 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:11.840499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b45e62f1-8b96-4e6a-b553-5a88e829af3d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:11.846210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5e8989d9-868a-4432-96e0-c46a5b307b24 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:11.848879 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b45e62f1-8b96-4e6a-b553-5a88e829af3d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.226938 Aug 24 16:46:11.849643 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 361/731] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:11 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:11.853909 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5e8989d9-868a-4432-96e0-c46a5b307b24 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.214844 Aug 24 16:46:11.854463 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 371/732] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:11 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:12.193422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8faea58a-1701-41ca-9a24-4b1ea5fee0b7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:12.194024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8faea58a-1701-41ca-9a24-4b1ea5fee0b7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:12.199849 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8faea58a-1701-41ca-9a24-4b1ea5fee0b7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:12.200365 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8faea58a-1701-41ca-9a24-4b1ea5fee0b7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:12.200793 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8faea58a-1701-41ca-9a24-4b1ea5fee0b7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:12.201471 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8faea58a-1701-41ca-9a24-4b1ea5fee0b7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:12.201919 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8faea58a-1701-41ca-9a24-4b1ea5fee0b7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:12.202334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8faea58a-1701-41ca-9a24-4b1ea5fee0b7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:12.341113 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8faea58a-1701-41ca-9a24-4b1ea5fee0b7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:12.349325 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8faea58a-1701-41ca-9a24-4b1ea5fee0b7 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1574 microversion: 2.1 time: 0.159714 Aug 24 16:46:12.349896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 362/733] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:12 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:12.873577 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6464b5e9-c3e5-444a-be10-0997a5e6bb9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:12.875078 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6464b5e9-c3e5-444a-be10-0997a5e6bb9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:12.875366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-58ab9644-5840-4cab-bcf0-c5a6b29b02a5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:12.876748 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-58ab9644-5840-4cab-bcf0-c5a6b29b02a5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:12.883505 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58ab9644-5840-4cab-bcf0-c5a6b29b02a5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:12.884018 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58ab9644-5840-4cab-bcf0-c5a6b29b02a5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:12.884453 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58ab9644-5840-4cab-bcf0-c5a6b29b02a5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:12.885467 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58ab9644-5840-4cab-bcf0-c5a6b29b02a5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:12.885930 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58ab9644-5840-4cab-bcf0-c5a6b29b02a5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:12.886357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58ab9644-5840-4cab-bcf0-c5a6b29b02a5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:12.886615 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6464b5e9-c3e5-444a-be10-0997a5e6bb9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:12.887745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6464b5e9-c3e5-444a-be10-0997a5e6bb9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:12.889010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6464b5e9-c3e5-444a-be10-0997a5e6bb9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:12.893634 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6464b5e9-c3e5-444a-be10-0997a5e6bb9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:12.894877 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6464b5e9-c3e5-444a-be10-0997a5e6bb9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:12.896046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6464b5e9-c3e5-444a-be10-0997a5e6bb9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:13.115937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-58ab9644-5840-4cab-bcf0-c5a6b29b02a5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:13.122829 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6464b5e9-c3e5-444a-be10-0997a5e6bb9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:13.123539 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-58ab9644-5840-4cab-bcf0-c5a6b29b02a5 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.252890 Aug 24 16:46:13.124131 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 363/734] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:12 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:13.128843 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-e9443511-2883-48d5-a29b-61f3fef47e70 req-07719ffb-b967-4e34-a59c-2389950f3470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d552f38-2ddf-4ab9-9879-394b70e69768", "tag": "96c147e1-5a95-4a34-b8b2-ba69d7923b79"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:13.130756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6464b5e9-c3e5-444a-be10-0997a5e6bb9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.264582 Aug 24 16:46:13.131319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 372/735] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:12 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:13.137792 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-e9443511-2883-48d5-a29b-61f3fef47e70 req-07719ffb-b967-4e34-a59c-2389950f3470 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:13.138265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-e9443511-2883-48d5-a29b-61f3fef47e70 req-07719ffb-b967-4e34-a59c-2389950f3470 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:13.138713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-e9443511-2883-48d5-a29b-61f3fef47e70 req-07719ffb-b967-4e34-a59c-2389950f3470 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:13.149868 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-e9443511-2883-48d5-a29b-61f3fef47e70 req-07719ffb-b967-4e34-a59c-2389950f3470 service nova] Creating event network-changed:96c147e1-5a95-4a34-b8b2-ba69d7923b79 for instance 3d552f38-2ddf-4ab9-9879-394b70e69768 on hv-cinder-77957 Aug 24 16:46:13.155140 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-e9443511-2883-48d5-a29b-61f3fef47e70 req-07719ffb-b967-4e34-a59c-2389950f3470 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029797 Aug 24 16:46:13.156107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 364/736] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:13.370882 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-90063d87-7c0a-49b6-9454-d4fe197ead4c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:13.371495 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-90063d87-7c0a-49b6-9454-d4fe197ead4c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:13.378023 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-90063d87-7c0a-49b6-9454-d4fe197ead4c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:13.378511 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-90063d87-7c0a-49b6-9454-d4fe197ead4c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:13.378941 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-90063d87-7c0a-49b6-9454-d4fe197ead4c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:13.379633 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-90063d87-7c0a-49b6-9454-d4fe197ead4c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:13.380116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-90063d87-7c0a-49b6-9454-d4fe197ead4c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:13.380543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-90063d87-7c0a-49b6-9454-d4fe197ead4c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:13.520349 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-90063d87-7c0a-49b6-9454-d4fe197ead4c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:13.527993 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-90063d87-7c0a-49b6-9454-d4fe197ead4c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1561 microversion: 2.1 time: 0.160927 Aug 24 16:46:13.528559 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 373/737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:13 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:14.147002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-aff3f1cd-76f9-4bf8-b9ee-8843d92902c3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:14.147670 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-aff3f1cd-76f9-4bf8-b9ee-8843d92902c3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:14.151472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f42ce071-db6d-491a-90de-45c59d907912 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:14.152123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f42ce071-db6d-491a-90de-45c59d907912 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:14.153721 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff3f1cd-76f9-4bf8-b9ee-8843d92902c3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:14.154191 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff3f1cd-76f9-4bf8-b9ee-8843d92902c3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:14.154631 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff3f1cd-76f9-4bf8-b9ee-8843d92902c3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:14.155446 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff3f1cd-76f9-4bf8-b9ee-8843d92902c3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:14.155922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff3f1cd-76f9-4bf8-b9ee-8843d92902c3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:14.156379 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aff3f1cd-76f9-4bf8-b9ee-8843d92902c3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:14.158666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f42ce071-db6d-491a-90de-45c59d907912 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:14.159158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f42ce071-db6d-491a-90de-45c59d907912 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:14.159666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f42ce071-db6d-491a-90de-45c59d907912 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:14.161818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f42ce071-db6d-491a-90de-45c59d907912 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:14.161818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f42ce071-db6d-491a-90de-45c59d907912 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:14.161818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f42ce071-db6d-491a-90de-45c59d907912 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:14.376506 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-aff3f1cd-76f9-4bf8-b9ee-8843d92902c3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:14.383598 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f42ce071-db6d-491a-90de-45c59d907912 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:14.383927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-aff3f1cd-76f9-4bf8-b9ee-8843d92902c3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1267 microversion: 2.1 time: 0.242563 Aug 24 16:46:14.384522 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 365/738] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:14 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:14.391972 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f42ce071-db6d-491a-90de-45c59d907912 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.244294 Aug 24 16:46:14.393158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 374/739] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:14 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:15.404523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ab432155-e1b4-460e-9059-57792742735d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:15.405169 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ab432155-e1b4-460e-9059-57792742735d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:15.412262 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab432155-e1b4-460e-9059-57792742735d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:15.412746 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab432155-e1b4-460e-9059-57792742735d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:15.413046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-37a45de0-428d-47e3-a44c-d83be23e7884 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:15.413478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab432155-e1b4-460e-9059-57792742735d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:15.413671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-37a45de0-428d-47e3-a44c-d83be23e7884 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:15.413856 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab432155-e1b4-460e-9059-57792742735d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:15.414305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab432155-e1b4-460e-9059-57792742735d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:15.414725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ab432155-e1b4-460e-9059-57792742735d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:15.420764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-37a45de0-428d-47e3-a44c-d83be23e7884 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:15.421428 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-37a45de0-428d-47e3-a44c-d83be23e7884 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:15.421681 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-37a45de0-428d-47e3-a44c-d83be23e7884 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:15.423062 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-37a45de0-428d-47e3-a44c-d83be23e7884 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:15.423565 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-37a45de0-428d-47e3-a44c-d83be23e7884 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:15.424126 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-37a45de0-428d-47e3-a44c-d83be23e7884 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:15.708225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ab432155-e1b4-460e-9059-57792742735d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:15.714432 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-37a45de0-428d-47e3-a44c-d83be23e7884 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:15.716042 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ab432155-e1b4-460e-9059-57792742735d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1453 microversion: 2.1 time: 0.315254 Aug 24 16:46:15.716848 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 366/740] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:15 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1453 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:15.722625 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-37a45de0-428d-47e3-a44c-d83be23e7884 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.313305 Aug 24 16:46:15.723366 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 375/741] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:15 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:15.736656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-45171289-5e74-4461-9485-ffb902c07f93 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:15.737269 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-45171289-5e74-4461-9485-ffb902c07f93 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:15.743199 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45171289-5e74-4461-9485-ffb902c07f93 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:15.743691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45171289-5e74-4461-9485-ffb902c07f93 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:15.744220 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45171289-5e74-4461-9485-ffb902c07f93 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:15.744925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45171289-5e74-4461-9485-ffb902c07f93 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:15.745382 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45171289-5e74-4461-9485-ffb902c07f93 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:15.745806 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-45171289-5e74-4461-9485-ffb902c07f93 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:15.962535 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-45171289-5e74-4461-9485-ffb902c07f93 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:15.970939 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-45171289-5e74-4461-9485-ffb902c07f93 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1453 microversion: 2.1 time: 0.238766 Aug 24 16:46:15.971587 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 367/742] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:15 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1453 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:16.744516 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-689c17be-b38d-405b-a8d5-a54a885cdcb0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:16.745169 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-689c17be-b38d-405b-a8d5-a54a885cdcb0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:16.752278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-689c17be-b38d-405b-a8d5-a54a885cdcb0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:16.753263 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-689c17be-b38d-405b-a8d5-a54a885cdcb0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:16.753701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-689c17be-b38d-405b-a8d5-a54a885cdcb0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:16.754409 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-689c17be-b38d-405b-a8d5-a54a885cdcb0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:16.755104 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-689c17be-b38d-405b-a8d5-a54a885cdcb0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:16.755688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-689c17be-b38d-405b-a8d5-a54a885cdcb0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:16.904551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-689c17be-b38d-405b-a8d5-a54a885cdcb0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:16.912555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-689c17be-b38d-405b-a8d5-a54a885cdcb0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.172096 Aug 24 16:46:16.913144 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 376/743] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:16 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:17.835253 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-2af84df3-684b-468a-b1bb-f8f26b4f02b6 req-c3e5736e-e732-4e54-9b13-43ba20695885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c16b9f1-a570-4574-9f31-55ee4d2c0345", "tag": "08e2ad33-cf8e-48c5-af02-bfc6e0668156"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:17.845540 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-2af84df3-684b-468a-b1bb-f8f26b4f02b6 req-c3e5736e-e732-4e54-9b13-43ba20695885 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:17.846022 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-2af84df3-684b-468a-b1bb-f8f26b4f02b6 req-c3e5736e-e732-4e54-9b13-43ba20695885 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:17.846452 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-2af84df3-684b-468a-b1bb-f8f26b4f02b6 req-c3e5736e-e732-4e54-9b13-43ba20695885 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:17.858128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-2af84df3-684b-468a-b1bb-f8f26b4f02b6 req-c3e5736e-e732-4e54-9b13-43ba20695885 service nova] Creating event network-changed:08e2ad33-cf8e-48c5-af02-bfc6e0668156 for instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 on hv-cinder-77957 Aug 24 16:46:17.864280 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-2af84df3-684b-468a-b1bb-f8f26b4f02b6 req-c3e5736e-e732-4e54-9b13-43ba20695885 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032608 Aug 24 16:46:17.864891 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 368/744] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:17.934260 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-97cf963c-221b-4671-813b-062e49e4f58c tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:17.934876 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-97cf963c-221b-4671-813b-062e49e4f58c tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:17.941576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97cf963c-221b-4671-813b-062e49e4f58c tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:17.942287 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97cf963c-221b-4671-813b-062e49e4f58c tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:17.942720 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97cf963c-221b-4671-813b-062e49e4f58c tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:17.943416 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97cf963c-221b-4671-813b-062e49e4f58c tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:17.943939 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97cf963c-221b-4671-813b-062e49e4f58c tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:17.944904 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-97cf963c-221b-4671-813b-062e49e4f58c tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:18.169779 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-97cf963c-221b-4671-813b-062e49e4f58c tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:18.181516 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-97cf963c-221b-4671-813b-062e49e4f58c tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.251514 Aug 24 16:46:18.182329 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 377/745] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:17 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:18.700097 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-047bd32d-2955-42cc-85a6-5585c5af30f0 req-340c3286-d5bd-4802-812d-7a7f3ab3cfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d552f38-2ddf-4ab9-9879-394b70e69768", "name": "network-vif-plugged", "status": "completed", "tag": "96c147e1-5a95-4a34-b8b2-ba69d7923b79"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:18.711780 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-047bd32d-2955-42cc-85a6-5585c5af30f0 req-340c3286-d5bd-4802-812d-7a7f3ab3cfad service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:18.712278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-047bd32d-2955-42cc-85a6-5585c5af30f0 req-340c3286-d5bd-4802-812d-7a7f3ab3cfad service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:18.712599 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-047bd32d-2955-42cc-85a6-5585c5af30f0 req-340c3286-d5bd-4802-812d-7a7f3ab3cfad service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:18.724243 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-047bd32d-2955-42cc-85a6-5585c5af30f0 req-340c3286-d5bd-4802-812d-7a7f3ab3cfad service nova] Creating event network-vif-plugged:96c147e1-5a95-4a34-b8b2-ba69d7923b79 for instance 3d552f38-2ddf-4ab9-9879-394b70e69768 on hv-cinder-77957 Aug 24 16:46:18.729235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-047bd32d-2955-42cc-85a6-5585c5af30f0 req-340c3286-d5bd-4802-812d-7a7f3ab3cfad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033073 Aug 24 16:46:18.730517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 369/746] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:19.203628 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9523e8e8-14a1-4b45-819f-eb668866118e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:19.204395 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9523e8e8-14a1-4b45-819f-eb668866118e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:19.210326 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523e8e8-14a1-4b45-819f-eb668866118e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:19.210810 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523e8e8-14a1-4b45-819f-eb668866118e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:19.211245 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523e8e8-14a1-4b45-819f-eb668866118e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:19.211930 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523e8e8-14a1-4b45-819f-eb668866118e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:19.212404 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523e8e8-14a1-4b45-819f-eb668866118e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:19.212828 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9523e8e8-14a1-4b45-819f-eb668866118e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:19.350933 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9523e8e8-14a1-4b45-819f-eb668866118e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:19.358943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9523e8e8-14a1-4b45-819f-eb668866118e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1358 microversion: 2.1 time: 0.159269 Aug 24 16:46:19.359502 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 378/747] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:19 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:20.379991 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-90b0f93e-562f-43d7-ba9f-996d6a4023c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:20.380688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-90b0f93e-562f-43d7-ba9f-996d6a4023c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:20.387113 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-90b0f93e-562f-43d7-ba9f-996d6a4023c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:20.387598 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-90b0f93e-562f-43d7-ba9f-996d6a4023c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:20.388073 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-90b0f93e-562f-43d7-ba9f-996d6a4023c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:20.388759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-90b0f93e-562f-43d7-ba9f-996d6a4023c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:20.389212 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-90b0f93e-562f-43d7-ba9f-996d6a4023c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:20.389632 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-90b0f93e-562f-43d7-ba9f-996d6a4023c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:20.523390 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-90b0f93e-562f-43d7-ba9f-996d6a4023c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:20.532691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-90b0f93e-562f-43d7-ba9f-996d6a4023c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1548 microversion: 2.1 time: 0.157709 Aug 24 16:46:20.533275 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 370/748] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:20 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:20.552622 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-61eeb4ac-9f39-4492-bbd7-8c2903778886 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:20.553234 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-61eeb4ac-9f39-4492-bbd7-8c2903778886 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:20.559194 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61eeb4ac-9f39-4492-bbd7-8c2903778886 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:20.559688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61eeb4ac-9f39-4492-bbd7-8c2903778886 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:20.560165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61eeb4ac-9f39-4492-bbd7-8c2903778886 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:20.560857 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61eeb4ac-9f39-4492-bbd7-8c2903778886 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:20.561312 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61eeb4ac-9f39-4492-bbd7-8c2903778886 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:20.561737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-61eeb4ac-9f39-4492-bbd7-8c2903778886 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:20.697848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-61eeb4ac-9f39-4492-bbd7-8c2903778886 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:20.706019 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-61eeb4ac-9f39-4492-bbd7-8c2903778886 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1548 microversion: 2.1 time: 0.157131 Aug 24 16:46:20.706581 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 379/749] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:20 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:20.725343 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:20.729971 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:20.730799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Searching by: {'deleted': False, 'project_id': '00a45ba3e79b425493703f960803cea1'} {{(pid=127165) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 16:46:20.737850 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:20.738327 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:20.738755 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:20.739470 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:20.739917 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:20.740368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:20.830954 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.multi_cell_list [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127165) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 16:46:20.923208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9c75879b-25d4-4d46-a6b2-77413cb4cbd6 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201389 Aug 24 16:46:20.923696 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 371/750] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Aug 24 16:46:20 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:20.934914 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1db68109-b028-4e1c-8ea9-3c1f3f7bfc07 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:20.935519 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1db68109-b028-4e1c-8ea9-3c1f3f7bfc07 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:20.942089 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1db68109-b028-4e1c-8ea9-3c1f3f7bfc07 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:20.949973 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1db68109-b028-4e1c-8ea9-3c1f3f7bfc07 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:20.952053 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1db68109-b028-4e1c-8ea9-3c1f3f7bfc07 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:20.952827 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1db68109-b028-4e1c-8ea9-3c1f3f7bfc07 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:20.954017 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1db68109-b028-4e1c-8ea9-3c1f3f7bfc07 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:20.954828 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1db68109-b028-4e1c-8ea9-3c1f3f7bfc07 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:21.090853 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1db68109-b028-4e1c-8ea9-3c1f3f7bfc07 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:21.095111 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=100 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:21.100304 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1db68109-b028-4e1c-8ea9-3c1f3f7bfc07 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1548 microversion: 2.1 time: 0.169220 Aug 24 16:46:21.100866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 380/751] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:20 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:22.649669 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a124538f-72b0-494e-93a4-cb7cffd48049 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "031e5b0f-8d13-46ce-b331-a574912be2b8"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:22.652004 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a124538f-72b0-494e-93a4-cb7cffd48049 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:22.658526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a124538f-72b0-494e-93a4-cb7cffd48049 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:22.659010 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a124538f-72b0-494e-93a4-cb7cffd48049 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:22.659449 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a124538f-72b0-494e-93a4-cb7cffd48049 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:22.660174 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a124538f-72b0-494e-93a4-cb7cffd48049 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:22.660630 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a124538f-72b0-494e-93a4-cb7cffd48049 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:22.661051 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a124538f-72b0-494e-93a4-cb7cffd48049 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:22.908510 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a124538f-72b0-494e-93a4-cb7cffd48049 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "POST /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262459 Aug 24 16:46:22.909287 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 372/752] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:46:22 2022] POST /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:28.913684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8d7f375d-97d2-4b07-ab8e-1d9fc55b6f48 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:28.915929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8d7f375d-97d2-4b07-ab8e-1d9fc55b6f48 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:28.918168 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:28.924032 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d7f375d-97d2-4b07-ab8e-1d9fc55b6f48 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:28.924521 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d7f375d-97d2-4b07-ab8e-1d9fc55b6f48 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:28.924956 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d7f375d-97d2-4b07-ab8e-1d9fc55b6f48 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:28.925748 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d7f375d-97d2-4b07-ab8e-1d9fc55b6f48 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:28.926202 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d7f375d-97d2-4b07-ab8e-1d9fc55b6f48 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:28.926624 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d7f375d-97d2-4b07-ab8e-1d9fc55b6f48 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:28.957837 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8d7f375d-97d2-4b07-ab8e-1d9fc55b6f48 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047997 Aug 24 16:46:28.958305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 381/753] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 24 16:46:28 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:29.022733 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-833a7aef-6473-4ad6-b994-bde48a0e06a5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:29.023315 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-833a7aef-6473-4ad6-b994-bde48a0e06a5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:29.025261 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:29.030352 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-833a7aef-6473-4ad6-b994-bde48a0e06a5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:29.030844 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-833a7aef-6473-4ad6-b994-bde48a0e06a5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:29.031281 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-833a7aef-6473-4ad6-b994-bde48a0e06a5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:29.032003 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-833a7aef-6473-4ad6-b994-bde48a0e06a5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:29.032521 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-833a7aef-6473-4ad6-b994-bde48a0e06a5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:29.032945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-833a7aef-6473-4ad6-b994-bde48a0e06a5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:29.064117 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-833a7aef-6473-4ad6-b994-bde48a0e06a5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:46:29.096938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:29.139052 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-833a7aef-6473-4ad6-b994-bde48a0e06a5 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 204 len: 0 microversion: 2.20 time: 0.121129 Aug 24 16:46:29.139636 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 373/754] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 24 16:46:29 2022] DELETE /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:46:29.148879 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:29.149485 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:29.155250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:29.155729 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:29.156233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:29.156953 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:29.157695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:29.158127 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:29.294549 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:29.303093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:29.304644 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:29.305801 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b93a129b-7416-4b40-853d-e3e8a2b1f90b tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.160751 Aug 24 16:46:29.306347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 382/755] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:29 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:30.329971 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:30.330681 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:30.337106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:30.337589 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:30.338020 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:30.338711 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:30.339169 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:30.339590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:30.474827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:30.482918 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:30.484437 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:30.486095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-80b3d23f-acd8-41de-aadc-bc610bb9f224 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.160372 Aug 24 16:46:30.486653 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 374/756] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:30 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:31.510180 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:31.511529 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:31.518873 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:31.519629 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:31.520092 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:31.520811 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:31.521384 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:31.521814 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:31.553617 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a63a8d4d-0e64-4000-ac1c-ac8165d9fbce tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:31.554977 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a63a8d4d-0e64-4000-ac1c-ac8165d9fbce tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:31.558716 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:31.562687 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a63a8d4d-0e64-4000-ac1c-ac8165d9fbce tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:31.564077 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a63a8d4d-0e64-4000-ac1c-ac8165d9fbce tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:31.564651 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a63a8d4d-0e64-4000-ac1c-ac8165d9fbce tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:31.565359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a63a8d4d-0e64-4000-ac1c-ac8165d9fbce tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:31.565820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a63a8d4d-0e64-4000-ac1c-ac8165d9fbce tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:31.566245 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a63a8d4d-0e64-4000-ac1c-ac8165d9fbce tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:31.868021 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:31.870805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a63a8d4d-0e64-4000-ac1c-ac8165d9fbce tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:31.876223 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:31.877963 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:31.879137 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a24c224a-4233-446d-972c-888c6fc6255c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1723 microversion: 2.20 time: 0.372977 Aug 24 16:46:31.879799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a63a8d4d-0e64-4000-ac1c-ac8165d9fbce tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1594 microversion: 2.1 time: 0.329935 Aug 24 16:46:31.879932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 383/757] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:31 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:31.880945 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 375/758] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:31 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1594 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:32.454333 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-d4afd890-2340-4f58-b891-08e3284b4f14 req-013ea2a8-1f76-48df-b3b4-b127dd266670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e736aeb-6bda-4b29-97e9-4f697ccdf966", "name": "network-vif-deleted", "tag": "3cb1bcfc-1858-4dec-acc8-8e6b442af514"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:32.464046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-d4afd890-2340-4f58-b891-08e3284b4f14 req-013ea2a8-1f76-48df-b3b4-b127dd266670 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.464866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-d4afd890-2340-4f58-b891-08e3284b4f14 req-013ea2a8-1f76-48df-b3b4-b127dd266670 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.465310 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-d4afd890-2340-4f58-b891-08e3284b4f14 req-013ea2a8-1f76-48df-b3b4-b127dd266670 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.478520 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-d4afd890-2340-4f58-b891-08e3284b4f14 req-013ea2a8-1f76-48df-b3b4-b127dd266670 service nova] Creating event network-vif-deleted:3cb1bcfc-1858-4dec-acc8-8e6b442af514 for instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 on hv-cinder-77957 Aug 24 16:46:32.485359 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-d4afd890-2340-4f58-b891-08e3284b4f14 req-013ea2a8-1f76-48df-b3b4-b127dd266670 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035116 Aug 24 16:46:32.490498 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 384/759] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:32.902814 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:32.903781 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:32.910881 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.911365 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.911794 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.912520 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.912965 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.913379 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.956930 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:32.957600 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:32.958179 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:32.958813 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.objects.instance [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lazy-loading 'fault' on Instance uuid 5e736aeb-6bda-4b29-97e9-4f697ccdf966 {{(pid=127165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:46:33.004467 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:33.013456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:33.015775 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79d593b826c64087bac576d2204302b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf93612acce4a868bf2105a6567855b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:33.017185 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-439621f9-0035-490e-bae8-0095e0a0fe6e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 200 len: 1371 microversion: 2.20 time: 0.118330 Aug 24 16:46:33.017973 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 376/760] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:32 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 16:46:33.614858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-ec4920d4-3613-4cd0-ab5e-9f73182a8d96 req-16f05af5-f2ac-4451-a619-27251ac31cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d552f38-2ddf-4ab9-9879-394b70e69768", "tag": "96c147e1-5a95-4a34-b8b2-ba69d7923b79"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:33.624965 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-ec4920d4-3613-4cd0-ab5e-9f73182a8d96 req-16f05af5-f2ac-4451-a619-27251ac31cc8 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:33.626340 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-ec4920d4-3613-4cd0-ab5e-9f73182a8d96 req-16f05af5-f2ac-4451-a619-27251ac31cc8 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:33.627250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-ec4920d4-3613-4cd0-ab5e-9f73182a8d96 req-16f05af5-f2ac-4451-a619-27251ac31cc8 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:33.643463 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-ec4920d4-3613-4cd0-ab5e-9f73182a8d96 req-16f05af5-f2ac-4451-a619-27251ac31cc8 service nova] Creating event network-changed:96c147e1-5a95-4a34-b8b2-ba69d7923b79 for instance 3d552f38-2ddf-4ab9-9879-394b70e69768 on hv-cinder-77957 Aug 24 16:46:33.649448 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-ec4920d4-3613-4cd0-ab5e-9f73182a8d96 req-16f05af5-f2ac-4451-a619-27251ac31cc8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038589 Aug 24 16:46:33.650132 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 385/761] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:34.040871 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:34.041697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:34.049473 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:34.050185 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:34.050803 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:34.051654 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:34.052355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:34.052932 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:34.084451 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] HTTP exception thrown: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Request method failure captured: Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 HTTP/1.1 Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlQ_Wh_PdJNBfQP53zSmmsIgXSPgoAenZWiRIdeNAzJL1NuvP2IPV_FM2rNRsFyQRBR_YsPqjjiVH0ceCMVtfVHb-YquigFy_7rVxcq957Z-HJJY-AoRdqXXst444QJoxh5Mn47HHBCQQt--9mkqAODak3rZTqiXWwGZLbDmzK9D2gY Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:46:34.086322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cdf93612acce4a868bf2105a6567855b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 79d593b826c64087bac576d2204302b4 Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:34.087820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '5e736aeb-6bda-4b29-97e9-4f697ccdf966'} Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:46:34.088725 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:34.090311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:34.092761 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Returning 404 to user: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:46:34.093799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-723b720f-8745-4b64-b9be-ddc3d23fc435 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 404 len: 111 microversion: 2.20 time: 0.056796 Aug 24 16:46:34.098835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 377/762] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:34 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:46:34.109599 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-05c4a621-a001-4d57-b14c-60b1f595eb5c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '.version_select at 0x7f063abf2550>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:34.139767 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-05c4a621-a001-4d57-b14c-60b1f595eb5c tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-732139095" status: 204 len: 0 microversion: 2.20 time: 0.038151 Aug 24 16:46:34.146215 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 386/763] 10.222.0.52 () {60 vars in 1259 bytes} [Wed Aug 24 16:46:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-732139095 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 16:46:34.991135 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ee4275ce-a30e-48af-9852-05ac0a0357c5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-487595940"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:34.991673 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ee4275ce-a30e-48af-9852-05ac0a0357c5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:34.998298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee4275ce-a30e-48af-9852-05ac0a0357c5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:34.999062 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee4275ce-a30e-48af-9852-05ac0a0357c5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:34.999701 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee4275ce-a30e-48af-9852-05ac0a0357c5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.001691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee4275ce-a30e-48af-9852-05ac0a0357c5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:35.005263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee4275ce-a30e-48af-9852-05ac0a0357c5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:35.005716 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee4275ce-a30e-48af-9852-05ac0a0357c5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.149631 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.network.security_group_api [None req-ee4275ce-a30e-48af-9852-05ac0a0357c5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Adding security group 147fded1-745f-4964-b6db-47ed28871f56 to port 96c147e1-5a95-4a34-b8b2-ba69d7923b79 Aug 24 16:46:35.709978 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ee4275ce-a30e-48af-9852-05ac0a0357c5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "POST /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/action" status: 202 len: 0 microversion: 2.1 time: 0.724416 Aug 24 16:46:35.710632 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 378/764] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:46:34 2022] POST /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:46:35.720325 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-02bcd9a5-a601-4151-96b3-290ac96ad281 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:35.721028 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-02bcd9a5-a601-4151-96b3-290ac96ad281 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:35.722126 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-0bf45118-c22d-4527-aacd-06b67f1bd827 req-53a1deb5-ede4-4221-9711-061cb795e1bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d552f38-2ddf-4ab9-9879-394b70e69768", "tag": "96c147e1-5a95-4a34-b8b2-ba69d7923b79"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:35.727666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02bcd9a5-a601-4151-96b3-290ac96ad281 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:35.728294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02bcd9a5-a601-4151-96b3-290ac96ad281 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:35.728734 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02bcd9a5-a601-4151-96b3-290ac96ad281 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.730020 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02bcd9a5-a601-4151-96b3-290ac96ad281 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:35.730494 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02bcd9a5-a601-4151-96b3-290ac96ad281 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:35.730994 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02bcd9a5-a601-4151-96b3-290ac96ad281 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.734884 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-0bf45118-c22d-4527-aacd-06b67f1bd827 req-53a1deb5-ede4-4221-9711-061cb795e1bb service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:35.737106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-0bf45118-c22d-4527-aacd-06b67f1bd827 req-53a1deb5-ede4-4221-9711-061cb795e1bb service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:35.737543 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-0bf45118-c22d-4527-aacd-06b67f1bd827 req-53a1deb5-ede4-4221-9711-061cb795e1bb service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:35.750145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-0bf45118-c22d-4527-aacd-06b67f1bd827 req-53a1deb5-ede4-4221-9711-061cb795e1bb service nova] Creating event network-changed:96c147e1-5a95-4a34-b8b2-ba69d7923b79 for instance 3d552f38-2ddf-4ab9-9879-394b70e69768 on hv-cinder-77957 Aug 24 16:46:35.756518 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-0bf45118-c22d-4527-aacd-06b67f1bd827 req-53a1deb5-ede4-4221-9711-061cb795e1bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039670 Aug 24 16:46:35.757428 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 379/765] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:35.989165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-02bcd9a5-a601-4151-96b3-290ac96ad281 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:35.998791 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-02bcd9a5-a601-4151-96b3-290ac96ad281 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1759 microversion: 2.1 time: 0.283684 Aug 24 16:46:35.999530 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 387/766] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:35 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1759 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:46:36.111740 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:36.112650 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:36.120807 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.121553 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.122147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.122862 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.123474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.123904 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.138310 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] HTTP exception thrown: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Request method failure captured: Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: DELETE /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 HTTP/1.1 Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlQ_Wh_PdJNBfQP53zSmmsIgXSPgoAenZWiRIdeNAzJL1NuvP2IPV_FM2rNRsFyQRBR_YsPqjjiVH0ceCMVtfVHb-YquigFy_7rVxcq957Z-HJJY-AoRdqXXst444QJoxh5Mn47HHBCQQt--9mkqAODak3rZTqiXWwGZLbDmzK9D2gY Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:46:36.140305 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cdf93612acce4a868bf2105a6567855b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 79d593b826c64087bac576d2204302b4 Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:36.142355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '5e736aeb-6bda-4b29-97e9-4f697ccdf966'} Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:46:36.143145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:36.147094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:36.151129 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Returning 404 to user: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:46:36.151129 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-305cc78d-5d32-40f6-8a32-6bf7b6f0c689 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 404 len: 111 microversion: 2.20 time: 0.034914 Aug 24 16:46:36.151129 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 380/767] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 24 16:46:36 2022] DELETE /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:46:36.153990 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:36.155137 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 5e736aeb-6bda-4b29-97e9-4f697ccdf966] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:36.163207 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.163711 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.164199 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.165091 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:36.165704 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:36.166295 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:36.181319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] HTTP exception thrown: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Request method failure captured: Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 HTTP/1.1 Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQ_Wh_PdJNBfQP53zSmmsIgXSPgoAenZWiRIdeNAzJL1NuvP2IPV_FM2rNRsFyQRBR_YsPqjjiVH0ceCMVtfVHb-YquigFy_7rVxcq957Z-HJJY-AoRdqXXst444QJoxh5Mn47HHBCQQt--9mkqAODak3rZTqiXWwGZLbDmzK9D2gY Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:46:36.183285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cdf93612acce4a868bf2105a6567855b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 79d593b826c64087bac576d2204302b4 Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:36.185116 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '5e736aeb-6bda-4b29-97e9-4f697ccdf966'} Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:46:36.185913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. Aug 24 16:46:36.187434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:46:36.190306 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Returning 404 to user: Instance 5e736aeb-6bda-4b29-97e9-4f697ccdf966 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:46:36.191371 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-fe661f76-9c43-4d43-ba12-cb20e455d407 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966" status: 404 len: 111 microversion: 2.20 time: 0.042131 Aug 24 16:46:36.195639 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 388/768] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:36 2022] GET /compute/v2.1/servers/5e736aeb-6bda-4b29-97e9-4f697ccdf966 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:46:37.364429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:37.364925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:37.373583 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:37.374438 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:37.375230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:37.377224 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:37.378009 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:37.378738 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:37.396220 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] HTTP exception thrown: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Request method failure captured: Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: DELETE /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da HTTP/1.1 Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlQ_Wh_PdJNBfQP53zSmmsIgXSPgoAenZWiRIdeNAzJL1NuvP2IPV_FM2rNRsFyQRBR_YsPqjjiVH0ceCMVtfVHb-YquigFy_7rVxcq957Z-HJJY-AoRdqXXst444QJoxh5Mn47HHBCQQt--9mkqAODak3rZTqiXWwGZLbDmzK9D2gY Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:46:37.397747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cdf93612acce4a868bf2105a6567855b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 79d593b826c64087bac576d2204302b4 Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:46:37.399368 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '66f46124-a6dc-4300-88a6-3143240719da'} Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:46:37.400278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:46:37.401702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:46:37.403391 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Returning 404 to user: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:46:37.403391 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4e8ca4be-4cfc-49f0-80aa-3a150df90d95 tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "DELETE /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 404 len: 111 microversion: 2.20 time: 0.039366 Aug 24 16:46:37.403391 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 381/769] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 24 16:46:37 2022] DELETE /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:46:37.408283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:37.408898 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] [instance: 66f46124-a6dc-4300-88a6-3143240719da] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:37.414799 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:37.415285 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:37.415721 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:37.416450 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:37.416906 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:37.417331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:37.430749 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] HTTP exception thrown: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Request method failure captured: Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da HTTP/1.1 Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlQ_Wh_PdJNBfQP53zSmmsIgXSPgoAenZWiRIdeNAzJL1NuvP2IPV_FM2rNRsFyQRBR_YsPqjjiVH0ceCMVtfVHb-YquigFy_7rVxcq957Z-HJJY-AoRdqXXst444QJoxh5Mn47HHBCQQt--9mkqAODak3rZTqiXWwGZLbDmzK9D2gY Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:46:37.432279 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cdf93612acce4a868bf2105a6567855b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cdf93612acce4a868bf2105a6567855b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: cdf93612acce4a868bf2105a6567855b Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-856297238 Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 79d593b826c64087bac576d2204302b4 Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeShelveTestJSON-856297238-project Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:46:37.433880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '66f46124-a6dc-4300-88a6-3143240719da'} Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:46:37.434762 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. Aug 24 16:46:37.436309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:46:37.437697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] Returning 404 to user: Instance 66f46124-a6dc-4300-88a6-3143240719da could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:46:37.437697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-88ec954b-1451-431d-a9a4-e91eb752da4e tempest-AttachVolumeShelveTestJSON-856297238 tempest-AttachVolumeShelveTestJSON-856297238-project] 10.222.0.52 "GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da" status: 404 len: 111 microversion: 2.20 time: 0.029679 Aug 24 16:46:37.437697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 389/770] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 16:46:37 2022] GET /compute/v2.1/servers/66f46124-a6dc-4300-88a6-3143240719da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:46:46.086355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-497fb18e-beaa-41d2-826e-1d293bec3eea tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'create', calling method: .version_select at 0x7f063a892430>, body: {"keypair": {"name": "tempest-keypair-731977943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILUQu1cGeAaQnNi2xbWNY3Ys84mpJergDu436PL8RFs6xVcRKhqxzOZ4WgzWDjNcce4HvEAVoT1wWWap9fi6NvTjrLTYTof3jIicaS2+c7WgkT0ATbft8NrgRPn3VAbtQ=="}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:46.101716 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-497fb18e-beaa-41d2-826e-1d293bec3eea tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Getting quotas for project ebd03bbf32154ccabb8d233f00347081. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:46.105543 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-497fb18e-beaa-41d2-826e-1d293bec3eea tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Getting quotas for user 481ae20977e8424cb460d8108905577d and project ebd03bbf32154ccabb8d233f00347081. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:46.130165 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-497fb18e-beaa-41d2-826e-1d293bec3eea tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165595 Aug 24 16:46:46.130766 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 382/771] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 16:46:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:47.408977 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2059800435", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3cab1eb-c87b-420a-a1f1-ac1c4fc49db1"}], "security_groups": [{"name": "tempest-securitygroup--2078417042"}], "key_name": "tempest-keypair-731977943", "user_data": "}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:47.417940 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:47.422789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=32 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:47.516566 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] validate_networks() for [('e3cab1eb-c87b-420a-a1f1-ac1c4fc49db1', None, None, None, None, None)] {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:46:47.897179 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:46:47.897603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:46:47.898074 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:46:47.898480 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:46:47.898915 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:46:47.908832 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:47.909321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:47.909752 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:47.910479 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:47.910932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:47.911352 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:47.928145 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Getting quotas for project ebd03bbf32154ccabb8d233f00347081. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:46:47.932095 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Getting quotas for user 481ae20977e8424cb460d8108905577d and project ebd03bbf32154ccabb8d233f00347081. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:46:47.943918 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:46:47.946251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:46:47.994954 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2ebf93bf-0287-4f35-a5fa-065c20f0b2bc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.591479 Aug 24 16:46:48.001872 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 390/772] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:46:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:46:48.008543 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d6fb59cc-8c45-497f-ac9c-c97325316c10 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:48.009167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d6fb59cc-8c45-497f-ac9c-c97325316c10 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:48.011559 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:48.070880 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d6fb59cc-8c45-497f-ac9c-c97325316c10 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:48.078149 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d6fb59cc-8c45-497f-ac9c-c97325316c10 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1237 microversion: 2.1 time: 0.073688 Aug 24 16:46:48.079569 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 383/773] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:48 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:49.103510 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-02472c99-0fe5-4b54-9f8c-b0ef8e3272bd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:49.104469 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-02472c99-0fe5-4b54-9f8c-b0ef8e3272bd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:49.111845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02472c99-0fe5-4b54-9f8c-b0ef8e3272bd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:49.112381 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02472c99-0fe5-4b54-9f8c-b0ef8e3272bd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:49.112868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02472c99-0fe5-4b54-9f8c-b0ef8e3272bd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:49.113521 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02472c99-0fe5-4b54-9f8c-b0ef8e3272bd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:49.113979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02472c99-0fe5-4b54-9f8c-b0ef8e3272bd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:49.114606 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-02472c99-0fe5-4b54-9f8c-b0ef8e3272bd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:49.211720 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-02472c99-0fe5-4b54-9f8c-b0ef8e3272bd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:49.221897 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-02472c99-0fe5-4b54-9f8c-b0ef8e3272bd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1297 microversion: 2.1 time: 0.124816 Aug 24 16:46:49.222712 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 391/774] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:49 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1297 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:50.245475 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-705601ea-d2fd-4f14-a8c8-36146f7b20bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:50.246221 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-705601ea-d2fd-4f14-a8c8-36146f7b20bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:50.253194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-705601ea-d2fd-4f14-a8c8-36146f7b20bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:50.253688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-705601ea-d2fd-4f14-a8c8-36146f7b20bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:50.254126 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-705601ea-d2fd-4f14-a8c8-36146f7b20bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:50.254823 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-705601ea-d2fd-4f14-a8c8-36146f7b20bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:50.255281 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-705601ea-d2fd-4f14-a8c8-36146f7b20bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:50.255702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-705601ea-d2fd-4f14-a8c8-36146f7b20bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:50.739106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-705601ea-d2fd-4f14-a8c8-36146f7b20bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:50.746508 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-705601ea-d2fd-4f14-a8c8-36146f7b20bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1363 microversion: 2.1 time: 0.504965 Aug 24 16:46:50.747072 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 384/775] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:50 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1363 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:50.860963 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-44d2465c-274e-4268-b1cb-931c971556a7 req-de5b9ca1-7807-4df5-918c-a0e12ae3cf6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c945bfc4-12ec-45eb-83b6-9e1c55d54e0e", "tag": "25979989-4af1-45cb-a77e-fb7d3359fce0"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:50.874113 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-44d2465c-274e-4268-b1cb-931c971556a7 req-de5b9ca1-7807-4df5-918c-a0e12ae3cf6b service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:50.874608 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-44d2465c-274e-4268-b1cb-931c971556a7 req-de5b9ca1-7807-4df5-918c-a0e12ae3cf6b service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:50.875063 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-44d2465c-274e-4268-b1cb-931c971556a7 req-de5b9ca1-7807-4df5-918c-a0e12ae3cf6b service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:50.888556 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-44d2465c-274e-4268-b1cb-931c971556a7 req-de5b9ca1-7807-4df5-918c-a0e12ae3cf6b service nova] Creating event network-changed:25979989-4af1-45cb-a77e-fb7d3359fce0 for instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e on hv-cinder-77957 Aug 24 16:46:50.894062 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-44d2465c-274e-4268-b1cb-931c971556a7 req-de5b9ca1-7807-4df5-918c-a0e12ae3cf6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037709 Aug 24 16:46:50.894840 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 392/776] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:51.767064 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d21aea3b-d9cd-433e-bdca-4c9511da4dbc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:51.767665 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d21aea3b-d9cd-433e-bdca-4c9511da4dbc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:51.774377 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d21aea3b-d9cd-433e-bdca-4c9511da4dbc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:51.774852 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d21aea3b-d9cd-433e-bdca-4c9511da4dbc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:51.775299 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d21aea3b-d9cd-433e-bdca-4c9511da4dbc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:51.775997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d21aea3b-d9cd-433e-bdca-4c9511da4dbc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:51.776449 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d21aea3b-d9cd-433e-bdca-4c9511da4dbc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:51.776861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d21aea3b-d9cd-433e-bdca-4c9511da4dbc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:51.904954 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d21aea3b-d9cd-433e-bdca-4c9511da4dbc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:51.913358 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d21aea3b-d9cd-433e-bdca-4c9511da4dbc tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1363 microversion: 2.1 time: 0.150185 Aug 24 16:46:51.914141 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 385/777] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:51 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:52.934588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2a654487-8597-4835-93f8-13f4ba55457f tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:52.935275 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2a654487-8597-4835-93f8-13f4ba55457f tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:52.941818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a654487-8597-4835-93f8-13f4ba55457f tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:52.942297 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a654487-8597-4835-93f8-13f4ba55457f tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:52.942728 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a654487-8597-4835-93f8-13f4ba55457f tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:52.943411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a654487-8597-4835-93f8-13f4ba55457f tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:52.943868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a654487-8597-4835-93f8-13f4ba55457f tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:52.944458 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2a654487-8597-4835-93f8-13f4ba55457f tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:53.075723 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2a654487-8597-4835-93f8-13f4ba55457f tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:53.083885 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2a654487-8597-4835-93f8-13f4ba55457f tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1363 microversion: 2.1 time: 0.153571 Aug 24 16:46:53.084419 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 393/778] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:52 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:54.104704 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-62771a31-9704-48d5-bbd2-3c1b7a6662a8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:54.105319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-62771a31-9704-48d5-bbd2-3c1b7a6662a8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:54.113230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62771a31-9704-48d5-bbd2-3c1b7a6662a8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:54.113757 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62771a31-9704-48d5-bbd2-3c1b7a6662a8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:54.114187 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62771a31-9704-48d5-bbd2-3c1b7a6662a8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:54.114879 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62771a31-9704-48d5-bbd2-3c1b7a6662a8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:54.115336 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62771a31-9704-48d5-bbd2-3c1b7a6662a8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:54.115756 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-62771a31-9704-48d5-bbd2-3c1b7a6662a8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:54.251122 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-62771a31-9704-48d5-bbd2-3c1b7a6662a8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:54.258700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-62771a31-9704-48d5-bbd2-3c1b7a6662a8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1363 microversion: 2.1 time: 0.158406 Aug 24 16:46:54.259275 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 386/779] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:54 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:55.279602 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-357a5ca2-2a2d-485d-9eff-67dfd5194971 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:55.280248 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-357a5ca2-2a2d-485d-9eff-67dfd5194971 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:55.286927 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-357a5ca2-2a2d-485d-9eff-67dfd5194971 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:55.287382 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-357a5ca2-2a2d-485d-9eff-67dfd5194971 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:55.287847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-357a5ca2-2a2d-485d-9eff-67dfd5194971 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:55.288575 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-357a5ca2-2a2d-485d-9eff-67dfd5194971 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:55.289063 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-357a5ca2-2a2d-485d-9eff-67dfd5194971 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:55.289489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-357a5ca2-2a2d-485d-9eff-67dfd5194971 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:55.422390 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-357a5ca2-2a2d-485d-9eff-67dfd5194971 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:55.430425 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-357a5ca2-2a2d-485d-9eff-67dfd5194971 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1363 microversion: 2.1 time: 0.154745 Aug 24 16:46:55.431000 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 394/780] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:55 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:56.450595 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8d50afd6-650c-4639-aa4d-9847d5f7402b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:56.451215 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8d50afd6-650c-4639-aa4d-9847d5f7402b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:56.457961 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d50afd6-650c-4639-aa4d-9847d5f7402b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:56.458434 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d50afd6-650c-4639-aa4d-9847d5f7402b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:56.458858 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d50afd6-650c-4639-aa4d-9847d5f7402b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:56.459540 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d50afd6-650c-4639-aa4d-9847d5f7402b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:56.460013 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d50afd6-650c-4639-aa4d-9847d5f7402b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:56.460437 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8d50afd6-650c-4639-aa4d-9847d5f7402b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:56.591115 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8d50afd6-650c-4639-aa4d-9847d5f7402b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:56.599233 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8d50afd6-650c-4639-aa4d-9847d5f7402b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1363 microversion: 2.1 time: 0.152497 Aug 24 16:46:56.599793 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 387/781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:56 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:57.069007 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-5e848084-1b06-45b1-88af-fb18d153986c req-fe6ffdd1-1fdc-4326-b98f-42326153b306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c945bfc4-12ec-45eb-83b6-9e1c55d54e0e", "name": "network-vif-plugged", "status": "completed", "tag": "25979989-4af1-45cb-a77e-fb7d3359fce0"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:46:57.080319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-5e848084-1b06-45b1-88af-fb18d153986c req-fe6ffdd1-1fdc-4326-b98f-42326153b306 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:57.081405 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-5e848084-1b06-45b1-88af-fb18d153986c req-fe6ffdd1-1fdc-4326-b98f-42326153b306 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:57.081835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-5e848084-1b06-45b1-88af-fb18d153986c req-fe6ffdd1-1fdc-4326-b98f-42326153b306 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:57.093411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-5e848084-1b06-45b1-88af-fb18d153986c req-fe6ffdd1-1fdc-4326-b98f-42326153b306 service nova] Creating event network-vif-plugged:25979989-4af1-45cb-a77e-fb7d3359fce0 for instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e on hv-cinder-77957 Aug 24 16:46:57.099247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-5e848084-1b06-45b1-88af-fb18d153986c req-fe6ffdd1-1fdc-4326-b98f-42326153b306 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034204 Aug 24 16:46:57.099827 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 395/782] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:46:57.620096 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1e5487c8-814b-40d3-b5ec-9b6de498eef3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:57.620716 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1e5487c8-814b-40d3-b5ec-9b6de498eef3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:57.627065 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e5487c8-814b-40d3-b5ec-9b6de498eef3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:57.627553 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e5487c8-814b-40d3-b5ec-9b6de498eef3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:57.628011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e5487c8-814b-40d3-b5ec-9b6de498eef3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:57.628705 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e5487c8-814b-40d3-b5ec-9b6de498eef3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:57.629158 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e5487c8-814b-40d3-b5ec-9b6de498eef3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:57.629582 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1e5487c8-814b-40d3-b5ec-9b6de498eef3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:57.909386 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1e5487c8-814b-40d3-b5ec-9b6de498eef3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:57.916982 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1e5487c8-814b-40d3-b5ec-9b6de498eef3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1363 microversion: 2.1 time: 0.300734 Aug 24 16:46:57.917541 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 388/783] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:57 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:58.938708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f8e13c9d-7438-4495-9b8e-ef73917a4dda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:58.939407 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f8e13c9d-7438-4495-9b8e-ef73917a4dda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:58.941377 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:58.942060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=6 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:58.948065 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8e13c9d-7438-4495-9b8e-ef73917a4dda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:58.948554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8e13c9d-7438-4495-9b8e-ef73917a4dda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:58.948994 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8e13c9d-7438-4495-9b8e-ef73917a4dda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:58.949693 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8e13c9d-7438-4495-9b8e-ef73917a4dda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:58.950150 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8e13c9d-7438-4495-9b8e-ef73917a4dda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:58.950576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f8e13c9d-7438-4495-9b8e-ef73917a4dda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:59.082926 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-f8e13c9d-7438-4495-9b8e-ef73917a4dda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:46:59.090592 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f8e13c9d-7438-4495-9b8e-ef73917a4dda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1548 microversion: 2.1 time: 0.156831 Aug 24 16:46:59.091152 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 396/784] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:46:58 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:46:59.111939 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f923522c-6cdb-478b-a1e1-9b415e606231 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:46:59.112471 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f923522c-6cdb-478b-a1e1-9b415e606231 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:46:59.114216 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=6 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:59.115291 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:59.121609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f923522c-6cdb-478b-a1e1-9b415e606231 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:59.122094 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f923522c-6cdb-478b-a1e1-9b415e606231 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:59.122523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f923522c-6cdb-478b-a1e1-9b415e606231 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:59.123208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f923522c-6cdb-478b-a1e1-9b415e606231 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:46:59.123654 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f923522c-6cdb-478b-a1e1-9b415e606231 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:46:59.124097 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f923522c-6cdb-478b-a1e1-9b415e606231 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:46:59.201407 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f923522c-6cdb-478b-a1e1-9b415e606231 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093997 Aug 24 16:46:59.201999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 389/785] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 16:46:59 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:00.110203 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-bf83eff3-6d76-4e49-83d9-72f19daf0b7a req-8ced84cf-8c8c-4e2b-806b-a07ea12e585a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c945bfc4-12ec-45eb-83b6-9e1c55d54e0e", "tag": "25979989-4af1-45cb-a77e-fb7d3359fce0"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:00.120419 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-bf83eff3-6d76-4e49-83d9-72f19daf0b7a req-8ced84cf-8c8c-4e2b-806b-a07ea12e585a service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:00.120933 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-bf83eff3-6d76-4e49-83d9-72f19daf0b7a req-8ced84cf-8c8c-4e2b-806b-a07ea12e585a service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:00.121672 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-bf83eff3-6d76-4e49-83d9-72f19daf0b7a req-8ced84cf-8c8c-4e2b-806b-a07ea12e585a service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:00.137581 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-bf83eff3-6d76-4e49-83d9-72f19daf0b7a req-8ced84cf-8c8c-4e2b-806b-a07ea12e585a service nova] Creating event network-changed:25979989-4af1-45cb-a77e-fb7d3359fce0 for instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e on hv-cinder-77957 Aug 24 16:47:00.144096 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-bf83eff3-6d76-4e49-83d9-72f19daf0b7a req-8ced84cf-8c8c-4e2b-806b-a07ea12e585a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037867 Aug 24 16:47:00.144711 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 397/786] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:01.651569 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-48bfe25e-8e0b-4602-a351-6441b1e4349d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:01.653831 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-48bfe25e-8e0b-4602-a351-6441b1e4349d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:01.660087 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bfe25e-8e0b-4602-a351-6441b1e4349d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:01.660565 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bfe25e-8e0b-4602-a351-6441b1e4349d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:01.660990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bfe25e-8e0b-4602-a351-6441b1e4349d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:01.661667 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bfe25e-8e0b-4602-a351-6441b1e4349d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:01.662112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bfe25e-8e0b-4602-a351-6441b1e4349d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:01.662524 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bfe25e-8e0b-4602-a351-6441b1e4349d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:01.736742 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-48bfe25e-8e0b-4602-a351-6441b1e4349d tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "POST /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/action" status: 202 len: 0 microversion: 2.1 time: 0.089339 Aug 24 16:47:01.737668 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 390/787] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:47:01 2022] POST /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:47:01.746403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-50034ed5-bf6a-4e89-830b-a192404a7003 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:01.747165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-50034ed5-bf6a-4e89-830b-a192404a7003 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:01.754099 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50034ed5-bf6a-4e89-830b-a192404a7003 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:01.754625 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50034ed5-bf6a-4e89-830b-a192404a7003 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:01.755091 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50034ed5-bf6a-4e89-830b-a192404a7003 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:01.755905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50034ed5-bf6a-4e89-830b-a192404a7003 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:01.756389 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50034ed5-bf6a-4e89-830b-a192404a7003 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:01.756836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-50034ed5-bf6a-4e89-830b-a192404a7003 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:01.995764 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-50034ed5-bf6a-4e89-830b-a192404a7003 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:02.004187 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-50034ed5-bf6a-4e89-830b-a192404a7003 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1751 microversion: 2.1 time: 0.262007 Aug 24 16:47:02.004782 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 398/788] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:01 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1751 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:03.026056 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7a9b753a-ce45-4441-a469-f984626088cf tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:03.026805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7a9b753a-ce45-4441-a469-f984626088cf tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:03.033623 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a9b753a-ce45-4441-a469-f984626088cf tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:03.034107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a9b753a-ce45-4441-a469-f984626088cf tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:03.034539 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a9b753a-ce45-4441-a469-f984626088cf tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:03.035232 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a9b753a-ce45-4441-a469-f984626088cf tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:03.035685 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a9b753a-ce45-4441-a469-f984626088cf tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:03.036138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7a9b753a-ce45-4441-a469-f984626088cf tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:03.179856 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-7a9b753a-ce45-4441-a469-f984626088cf tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:03.188809 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7a9b753a-ce45-4441-a469-f984626088cf tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1756 microversion: 2.1 time: 0.167445 Aug 24 16:47:03.189374 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 391/789] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:03 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:04.210819 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-032fb363-2320-4d8c-82e6-516236f1f8d3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:04.211526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-032fb363-2320-4d8c-82e6-516236f1f8d3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:04.218078 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-032fb363-2320-4d8c-82e6-516236f1f8d3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:04.219584 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-032fb363-2320-4d8c-82e6-516236f1f8d3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:04.220120 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-032fb363-2320-4d8c-82e6-516236f1f8d3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:04.220814 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-032fb363-2320-4d8c-82e6-516236f1f8d3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:04.221272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-032fb363-2320-4d8c-82e6-516236f1f8d3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:04.221699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-032fb363-2320-4d8c-82e6-516236f1f8d3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:04.366115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-032fb363-2320-4d8c-82e6-516236f1f8d3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:04.374289 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-032fb363-2320-4d8c-82e6-516236f1f8d3 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1756 microversion: 2.1 time: 0.167844 Aug 24 16:47:04.375530 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 399/790] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:04 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:05.397922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-844727a4-78aa-47b7-bade-456375db078a tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:05.398528 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-844727a4-78aa-47b7-bade-456375db078a tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:05.405189 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-844727a4-78aa-47b7-bade-456375db078a tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:05.405673 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-844727a4-78aa-47b7-bade-456375db078a tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:05.406109 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-844727a4-78aa-47b7-bade-456375db078a tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:05.407437 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-844727a4-78aa-47b7-bade-456375db078a tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:05.407902 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-844727a4-78aa-47b7-bade-456375db078a tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:05.408351 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-844727a4-78aa-47b7-bade-456375db078a tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:05.552686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-844727a4-78aa-47b7-bade-456375db078a tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:05.560753 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-844727a4-78aa-47b7-bade-456375db078a tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1756 microversion: 2.1 time: 0.166801 Aug 24 16:47:05.561319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 392/791] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:05 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:06.582845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8e5fe9e0-612e-4a61-b94a-e9eb2cb43714 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:06.583453 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8e5fe9e0-612e-4a61-b94a-e9eb2cb43714 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:06.589408 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8e5fe9e0-612e-4a61-b94a-e9eb2cb43714 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:06.589892 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8e5fe9e0-612e-4a61-b94a-e9eb2cb43714 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:06.590322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8e5fe9e0-612e-4a61-b94a-e9eb2cb43714 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:06.591011 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8e5fe9e0-612e-4a61-b94a-e9eb2cb43714 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:06.591465 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8e5fe9e0-612e-4a61-b94a-e9eb2cb43714 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:06.591897 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8e5fe9e0-612e-4a61-b94a-e9eb2cb43714 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:06.735984 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8e5fe9e0-612e-4a61-b94a-e9eb2cb43714 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:06.745008 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8e5fe9e0-612e-4a61-b94a-e9eb2cb43714 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1756 microversion: 2.1 time: 0.166722 Aug 24 16:47:06.745638 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 400/792] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:06 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:07.767434 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8f08afdb-5089-49d5-a33b-3f270461f7be tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:07.768323 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8f08afdb-5089-49d5-a33b-3f270461f7be tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:07.774805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f08afdb-5089-49d5-a33b-3f270461f7be tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:07.775290 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f08afdb-5089-49d5-a33b-3f270461f7be tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:07.775731 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f08afdb-5089-49d5-a33b-3f270461f7be tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:07.776451 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f08afdb-5089-49d5-a33b-3f270461f7be tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:07.776914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f08afdb-5089-49d5-a33b-3f270461f7be tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:07.777336 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f08afdb-5089-49d5-a33b-3f270461f7be tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:07.926276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8f08afdb-5089-49d5-a33b-3f270461f7be tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:07.934405 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8f08afdb-5089-49d5-a33b-3f270461f7be tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1756 microversion: 2.1 time: 0.171490 Aug 24 16:47:07.934973 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 393/793] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:07 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:08.956521 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1fad4a61-c890-47fc-912d-1221e24c37dd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:08.957060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1fad4a61-c890-47fc-912d-1221e24c37dd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:08.963028 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1fad4a61-c890-47fc-912d-1221e24c37dd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:08.963507 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1fad4a61-c890-47fc-912d-1221e24c37dd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:08.963934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1fad4a61-c890-47fc-912d-1221e24c37dd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:08.964635 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1fad4a61-c890-47fc-912d-1221e24c37dd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:08.965082 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1fad4a61-c890-47fc-912d-1221e24c37dd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:08.965501 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1fad4a61-c890-47fc-912d-1221e24c37dd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:09.106208 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-1fad4a61-c890-47fc-912d-1221e24c37dd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:09.114932 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1fad4a61-c890-47fc-912d-1221e24c37dd tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1756 microversion: 2.1 time: 0.162993 Aug 24 16:47:09.115492 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 401/794] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:08 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:10.137935 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b24bf533-4122-41b6-bc79-5f5b3d4fc6c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:10.138544 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b24bf533-4122-41b6-bc79-5f5b3d4fc6c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:10.146402 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b24bf533-4122-41b6-bc79-5f5b3d4fc6c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:10.146884 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b24bf533-4122-41b6-bc79-5f5b3d4fc6c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:10.147323 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b24bf533-4122-41b6-bc79-5f5b3d4fc6c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:10.148032 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b24bf533-4122-41b6-bc79-5f5b3d4fc6c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:10.148484 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b24bf533-4122-41b6-bc79-5f5b3d4fc6c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:10.148901 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b24bf533-4122-41b6-bc79-5f5b3d4fc6c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:10.307203 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b24bf533-4122-41b6-bc79-5f5b3d4fc6c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:10.316188 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b24bf533-4122-41b6-bc79-5f5b3d4fc6c0 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1756 microversion: 2.1 time: 0.182067 Aug 24 16:47:10.316771 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 394/795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:10 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:11.338595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-72aa5789-de02-448b-ab6b-de34d6fbe5ab tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:11.339207 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-72aa5789-de02-448b-ab6b-de34d6fbe5ab tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:11.345906 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72aa5789-de02-448b-ab6b-de34d6fbe5ab tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:11.346395 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72aa5789-de02-448b-ab6b-de34d6fbe5ab tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:11.346833 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72aa5789-de02-448b-ab6b-de34d6fbe5ab tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:11.347522 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72aa5789-de02-448b-ab6b-de34d6fbe5ab tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:11.348001 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72aa5789-de02-448b-ab6b-de34d6fbe5ab tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:11.348429 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72aa5789-de02-448b-ab6b-de34d6fbe5ab tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:11.487852 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-72aa5789-de02-448b-ab6b-de34d6fbe5ab tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:11.496056 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-72aa5789-de02-448b-ab6b-de34d6fbe5ab tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1756 microversion: 2.1 time: 0.161436 Aug 24 16:47:11.496631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 402/796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:11 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:12.518656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ed5a8c5e-1759-40a6-a7ba-fbef2ef371b8 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:12.519320 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ed5a8c5e-1759-40a6-a7ba-fbef2ef371b8 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:12.525699 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed5a8c5e-1759-40a6-a7ba-fbef2ef371b8 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:12.526183 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed5a8c5e-1759-40a6-a7ba-fbef2ef371b8 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:12.526614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed5a8c5e-1759-40a6-a7ba-fbef2ef371b8 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:12.527298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed5a8c5e-1759-40a6-a7ba-fbef2ef371b8 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:12.527751 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed5a8c5e-1759-40a6-a7ba-fbef2ef371b8 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:12.528210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ed5a8c5e-1759-40a6-a7ba-fbef2ef371b8 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:12.673635 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ed5a8c5e-1759-40a6-a7ba-fbef2ef371b8 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:12.681743 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ed5a8c5e-1759-40a6-a7ba-fbef2ef371b8 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1756 microversion: 2.1 time: 0.167993 Aug 24 16:47:12.682301 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 395/797] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:12 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:13.703152 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e97ba013-01a1-41e8-af6a-9223d14a25d9 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:13.703766 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e97ba013-01a1-41e8-af6a-9223d14a25d9 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:13.710641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e97ba013-01a1-41e8-af6a-9223d14a25d9 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:13.711123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e97ba013-01a1-41e8-af6a-9223d14a25d9 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:13.711551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e97ba013-01a1-41e8-af6a-9223d14a25d9 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:13.712336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e97ba013-01a1-41e8-af6a-9223d14a25d9 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:13.712788 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e97ba013-01a1-41e8-af6a-9223d14a25d9 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:13.713204 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e97ba013-01a1-41e8-af6a-9223d14a25d9 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:13.855597 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e97ba013-01a1-41e8-af6a-9223d14a25d9 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:13.863755 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e97ba013-01a1-41e8-af6a-9223d14a25d9 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1759 microversion: 2.1 time: 0.164468 Aug 24 16:47:13.864362 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 403/798] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:13 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:35.101956 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-a8a28b6a-1622-46a6-a91a-a2fbc742dc20 req-d565f7ed-054a-4efe-8c04-ff65aebf6883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e451e3e-9a42-40af-aff5-e8f8938252db", "tag": "bdb45216-e99f-41b9-b9d6-611a8882cee0"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:35.105801 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f9d047b0-6ea0-42b2-9c5c-e292b20481e0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:35.106313 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f9d047b0-6ea0-42b2-9c5c-e292b20481e0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:35.110555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=13 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:35.110555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:35.110850 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:35.111376 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=68 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:35.114692 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a8a28b6a-1622-46a6-a91a-a2fbc742dc20 req-d565f7ed-054a-4efe-8c04-ff65aebf6883 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:35.115245 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a8a28b6a-1622-46a6-a91a-a2fbc742dc20 req-d565f7ed-054a-4efe-8c04-ff65aebf6883 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:35.116164 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a8a28b6a-1622-46a6-a91a-a2fbc742dc20 req-d565f7ed-054a-4efe-8c04-ff65aebf6883 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:35.117907 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9d047b0-6ea0-42b2-9c5c-e292b20481e0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:35.118440 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9d047b0-6ea0-42b2-9c5c-e292b20481e0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:35.119238 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9d047b0-6ea0-42b2-9c5c-e292b20481e0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:35.120592 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9d047b0-6ea0-42b2-9c5c-e292b20481e0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:35.122186 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9d047b0-6ea0-42b2-9c5c-e292b20481e0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:35.122607 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f9d047b0-6ea0-42b2-9c5c-e292b20481e0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:35.130128 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-a8a28b6a-1622-46a6-a91a-a2fbc742dc20 req-d565f7ed-054a-4efe-8c04-ff65aebf6883 service nova] Creating event network-changed:bdb45216-e99f-41b9-b9d6-611a8882cee0 for instance 8e451e3e-9a42-40af-aff5-e8f8938252db on hv-cinder-77957 Aug 24 16:47:35.135465 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-a8a28b6a-1622-46a6-a91a-a2fbc742dc20 req-d565f7ed-054a-4efe-8c04-ff65aebf6883 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037128 Aug 24 16:47:35.136434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 404/799] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:35.155724 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f9d047b0-6ea0-42b2-9c5c-e292b20481e0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:47:35.239983 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f9d047b0-6ea0-42b2-9c5c-e292b20481e0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 204 len: 0 microversion: 2.1 time: 0.144517 Aug 24 16:47:35.240588 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 396/800] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:47:35 2022] DELETE /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:47:35.250985 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3d5b2e17-0646-4cfe-bc1d-4b84b501e468 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:35.252186 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3d5b2e17-0646-4cfe-bc1d-4b84b501e468 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:35.265323 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d5b2e17-0646-4cfe-bc1d-4b84b501e468 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:35.266148 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d5b2e17-0646-4cfe-bc1d-4b84b501e468 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:35.266775 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d5b2e17-0646-4cfe-bc1d-4b84b501e468 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:35.267931 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d5b2e17-0646-4cfe-bc1d-4b84b501e468 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:35.269126 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d5b2e17-0646-4cfe-bc1d-4b84b501e468 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:35.269916 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3d5b2e17-0646-4cfe-bc1d-4b84b501e468 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:35.421665 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-3d5b2e17-0646-4cfe-bc1d-4b84b501e468 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:35.430750 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3d5b2e17-0646-4cfe-bc1d-4b84b501e468 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.185100 Aug 24 16:47:35.431342 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 405/801] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:35 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:36.350013 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ba420ac0-bac1-457e-bc43-630f1b329e1d tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:36.350566 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ba420ac0-bac1-457e-bc43-630f1b329e1d tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:36.356974 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba420ac0-bac1-457e-bc43-630f1b329e1d tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:36.357458 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba420ac0-bac1-457e-bc43-630f1b329e1d tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:36.357892 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba420ac0-bac1-457e-bc43-630f1b329e1d tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:36.358622 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba420ac0-bac1-457e-bc43-630f1b329e1d tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:36.359076 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba420ac0-bac1-457e-bc43-630f1b329e1d tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:36.359497 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ba420ac0-bac1-457e-bc43-630f1b329e1d tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:36.384081 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ba420ac0-bac1-457e-bc43-630f1b329e1d tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/ips" status: 200 len: 144 microversion: 2.1 time: 0.039272 Aug 24 16:47:36.384638 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 397/802] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 16:47:36 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:36.456212 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-01eba1c4-626a-47f1-a107-c58c2bad1a80 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:36.456844 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-01eba1c4-626a-47f1-a107-c58c2bad1a80 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:36.462917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-01eba1c4-626a-47f1-a107-c58c2bad1a80 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:36.463408 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-01eba1c4-626a-47f1-a107-c58c2bad1a80 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:36.463870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-01eba1c4-626a-47f1-a107-c58c2bad1a80 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:36.464657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-01eba1c4-626a-47f1-a107-c58c2bad1a80 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:36.465109 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-01eba1c4-626a-47f1-a107-c58c2bad1a80 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:36.465530 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-01eba1c4-626a-47f1-a107-c58c2bad1a80 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:36.651012 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-01eba1c4-626a-47f1-a107-c58c2bad1a80 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:36.659117 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-01eba1c4-626a-47f1-a107-c58c2bad1a80 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1567 microversion: 2.1 time: 0.206465 Aug 24 16:47:36.659766 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 406/803] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:36 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:37.552973 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-a5e9351a-3ae9-44c9-9dbc-576c1d1d50a2 req-6ef37d97-3665-451e-b3c7-58a542d7a00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e451e3e-9a42-40af-aff5-e8f8938252db", "name": "network-vif-deleted", "tag": "bdb45216-e99f-41b9-b9d6-611a8882cee0"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:37.564387 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-a5e9351a-3ae9-44c9-9dbc-576c1d1d50a2 req-6ef37d97-3665-451e-b3c7-58a542d7a00e service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:37.565847 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-a5e9351a-3ae9-44c9-9dbc-576c1d1d50a2 req-6ef37d97-3665-451e-b3c7-58a542d7a00e service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:37.566358 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-a5e9351a-3ae9-44c9-9dbc-576c1d1d50a2 req-6ef37d97-3665-451e-b3c7-58a542d7a00e service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:37.582320 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-a5e9351a-3ae9-44c9-9dbc-576c1d1d50a2 req-6ef37d97-3665-451e-b3c7-58a542d7a00e service nova] Creating event network-vif-deleted:bdb45216-e99f-41b9-b9d6-611a8882cee0 for instance 8e451e3e-9a42-40af-aff5-e8f8938252db on hv-cinder-77957 Aug 24 16:47:37.587048 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-a5e9351a-3ae9-44c9-9dbc-576c1d1d50a2 req-6ef37d97-3665-451e-b3c7-58a542d7a00e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038996 Aug 24 16:47:37.587646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 398/804] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:37.683935 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-16ec6807-c1f6-4db2-b2d6-0eac7a0face0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:37.684644 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-16ec6807-c1f6-4db2-b2d6-0eac7a0face0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:37.692314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-16ec6807-c1f6-4db2-b2d6-0eac7a0face0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:37.693818 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-16ec6807-c1f6-4db2-b2d6-0eac7a0face0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:37.694259 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-16ec6807-c1f6-4db2-b2d6-0eac7a0face0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:37.694966 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-16ec6807-c1f6-4db2-b2d6-0eac7a0face0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:37.695424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-16ec6807-c1f6-4db2-b2d6-0eac7a0face0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:37.695851 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-16ec6807-c1f6-4db2-b2d6-0eac7a0face0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:37.769739 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-16ec6807-c1f6-4db2-b2d6-0eac7a0face0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb81fa5765c44a0afa8d9fb4786272c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd41122fd4e94aa786798d8f54214f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:37.778200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-16ec6807-c1f6-4db2-b2d6-0eac7a0face0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 200 len: 1217 microversion: 2.1 time: 0.101025 Aug 24 16:47:37.778781 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 407/805] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:37 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:47:38.805058 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:38.805657 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] [instance: 8e451e3e-9a42-40af-aff5-e8f8938252db] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:38.811865 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:38.812520 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:38.812967 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:38.813686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:38.814154 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:38.814593 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:38.828389 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] HTTP exception thrown: Instance 8e451e3e-9a42-40af-aff5-e8f8938252db could not be found. Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Request method failure captured: Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db HTTP/1.1 Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlTl_yz_O-U10NyneD1gf7LWej6LaI4ecIL8NnN58_vwNS0zffuN3pZviaBajG8FR9recrcbepVVn88cGovLlFY39M0gk05svGOxv986zDEqrB_Uxg5R37At9LydQgInRpjov53J6jh5VSZdttsRjCMm94xK4A11Nkpa84x53D1-omw Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: cd41122fd4e94aa786798d8f54214f0a Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-TestShelveInstance-1182737060 Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:47:38.830024 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cd41122fd4e94aa786798d8f54214f0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd41122fd4e94aa786798d8f54214f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cd41122fd4e94aa786798d8f54214f0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cd41122fd4e94aa786798d8f54214f0a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-TestShelveInstance-1182737060 Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: cd41122fd4e94aa786798d8f54214f0a Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-TestShelveInstance-1182737060 Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-TestShelveInstance-1182737060-project Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 9fb81fa5765c44a0afa8d9fb4786272c Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-TestShelveInstance-1182737060-project Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 8e451e3e-9a42-40af-aff5-e8f8938252db could not be found. Aug 24 16:47:38.832361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '8e451e3e-9a42-40af-aff5-e8f8938252db'} Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e451e3e-9a42-40af-aff5-e8f8938252db could not be found. Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:47:38.833385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e451e3e-9a42-40af-aff5-e8f8938252db could not be found. Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e451e3e-9a42-40af-aff5-e8f8938252db could not be found. Aug 24 16:47:38.835016 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:47:38.836455 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Returning 404 to user: Instance 8e451e3e-9a42-40af-aff5-e8f8938252db could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:47:38.836455 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e39413a7-68ba-4730-8820-169a40b302a0 tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db" status: 404 len: 111 microversion: 2.1 time: 0.032395 Aug 24 16:47:38.836455 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 399/806] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:38 2022] GET /compute/v2.1/servers/8e451e3e-9a42-40af-aff5-e8f8938252db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:47:38.992848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7e211ebb-e118-4374-b865-526cb90fa04c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] Calling method '.version_select at 0x7f063aad1940>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:39.012709 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7e211ebb-e118-4374-b865-526cb90fa04c tempest-TestShelveInstance-1182737060 tempest-TestShelveInstance-1182737060-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-501083313" status: 202 len: 0 microversion: 2.1 time: 0.024277 Aug 24 16:47:39.013287 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 408/807] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 16:47:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-501083313 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:47:39.496598 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-686ec50a-d4dc-4eb4-a9e4-8d68dfc9ffb9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe2d86ed-2d68-48dc-bea7-356a74f3d481"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:39.498996 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-686ec50a-d4dc-4eb4-a9e4-8d68dfc9ffb9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:39.505240 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-686ec50a-d4dc-4eb4-a9e4-8d68dfc9ffb9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:39.505727 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-686ec50a-d4dc-4eb4-a9e4-8d68dfc9ffb9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:39.506172 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-686ec50a-d4dc-4eb4-a9e4-8d68dfc9ffb9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:39.506864 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-686ec50a-d4dc-4eb4-a9e4-8d68dfc9ffb9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:39.507320 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-686ec50a-d4dc-4eb4-a9e4-8d68dfc9ffb9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:39.507744 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-686ec50a-d4dc-4eb4-a9e4-8d68dfc9ffb9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:39.758661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-686ec50a-d4dc-4eb4-a9e4-8d68dfc9ffb9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266017 Aug 24 16:47:39.759457 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 400/808] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:47:39 2022] POST /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:46.297753 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-aa2f8329-8ba2-4da8-ad8d-fbead7c95ad9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:46.304948 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aa2f8329-8ba2-4da8-ad8d-fbead7c95ad9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.305528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aa2f8329-8ba2-4da8-ad8d-fbead7c95ad9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.306043 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-aa2f8329-8ba2-4da8-ad8d-fbead7c95ad9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.367023 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-aa2f8329-8ba2-4da8-ad8d-fbead7c95ad9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Going to try to stop instance {{(pid=127166) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 16:47:46.411181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-aa2f8329-8ba2-4da8-ad8d-fbead7c95ad9 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.117335 Aug 24 16:47:46.414945 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 409/809] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:47:46 2022] POST /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:47:46.422527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-5a0c091c-f0e4-4c5a-90ad-22c6ce7f8507 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:46.423308 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-5a0c091c-f0e4-4c5a-90ad-22c6ce7f8507 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:46.432250 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a0c091c-f0e4-4c5a-90ad-22c6ce7f8507 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.433019 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a0c091c-f0e4-4c5a-90ad-22c6ce7f8507 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.433786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a0c091c-f0e4-4c5a-90ad-22c6ce7f8507 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.434619 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a0c091c-f0e4-4c5a-90ad-22c6ce7f8507 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:46.435070 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a0c091c-f0e4-4c5a-90ad-22c6ce7f8507 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:46.435498 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a0c091c-f0e4-4c5a-90ad-22c6ce7f8507 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:46.588559 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5a0c091c-f0e4-4c5a-90ad-22c6ce7f8507 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:46.601959 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-5a0c091c-f0e4-4c5a-90ad-22c6ce7f8507 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1722 microversion: 2.1 time: 0.185127 Aug 24 16:47:46.602550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 401/810] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:46 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:47.627753 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-838ae5a9-c1a6-436e-be94-a00ee0452666 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:47.628470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-838ae5a9-c1a6-436e-be94-a00ee0452666 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:47.634532 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-838ae5a9-c1a6-436e-be94-a00ee0452666 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:47.635010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-838ae5a9-c1a6-436e-be94-a00ee0452666 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:47.635439 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-838ae5a9-c1a6-436e-be94-a00ee0452666 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:47.636189 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-838ae5a9-c1a6-436e-be94-a00ee0452666 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:47.636640 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-838ae5a9-c1a6-436e-be94-a00ee0452666 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:47.637059 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-838ae5a9-c1a6-436e-be94-a00ee0452666 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:47.769661 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-838ae5a9-c1a6-436e-be94-a00ee0452666 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:47.778208 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-838ae5a9-c1a6-436e-be94-a00ee0452666 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1722 microversion: 2.1 time: 0.155182 Aug 24 16:47:47.778756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 410/811] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:47 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:47.782755 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7b7ef4eb-81fc-4625-bb0d-242a09f93bb5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-487595940"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:47.783365 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7b7ef4eb-81fc-4625-bb0d-242a09f93bb5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:47.789771 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b7ef4eb-81fc-4625-bb0d-242a09f93bb5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:47.790260 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b7ef4eb-81fc-4625-bb0d-242a09f93bb5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:47.790684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b7ef4eb-81fc-4625-bb0d-242a09f93bb5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:47.791385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b7ef4eb-81fc-4625-bb0d-242a09f93bb5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:47.791833 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b7ef4eb-81fc-4625-bb0d-242a09f93bb5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:47.792299 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7b7ef4eb-81fc-4625-bb0d-242a09f93bb5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:47.924219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.network.security_group_api [None req-7b7ef4eb-81fc-4625-bb0d-242a09f93bb5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Removing security group 147fded1-745f-4964-b6db-47ed28871f56 from port 96c147e1-5a95-4a34-b8b2-ba69d7923b79 Aug 24 16:47:48.234668 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7b7ef4eb-81fc-4625-bb0d-242a09f93bb5 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "POST /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/action" status: 202 len: 0 microversion: 2.1 time: 0.455747 Aug 24 16:47:48.235533 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 402/812] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:47:47 2022] POST /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 16:47:48.245249 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-09d59609-5667-4e88-bfeb-27130196b0eb req-c3333263-c425-4173-8188-7004814bcd4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d552f38-2ddf-4ab9-9879-394b70e69768", "tag": "96c147e1-5a95-4a34-b8b2-ba69d7923b79"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:48.259507 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-09d59609-5667-4e88-bfeb-27130196b0eb req-c3333263-c425-4173-8188-7004814bcd4f service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:48.261129 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-09d59609-5667-4e88-bfeb-27130196b0eb req-c3333263-c425-4173-8188-7004814bcd4f service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:48.261771 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-09d59609-5667-4e88-bfeb-27130196b0eb req-c3333263-c425-4173-8188-7004814bcd4f service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:48.277041 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-09d59609-5667-4e88-bfeb-27130196b0eb req-c3333263-c425-4173-8188-7004814bcd4f service nova] Creating event network-changed:96c147e1-5a95-4a34-b8b2-ba69d7923b79 for instance 3d552f38-2ddf-4ab9-9879-394b70e69768 on hv-cinder-77957 Aug 24 16:47:48.283108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-09d59609-5667-4e88-bfeb-27130196b0eb req-c3333263-c425-4173-8188-7004814bcd4f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042589 Aug 24 16:47:48.284941 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 411/813] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:48.799383 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-287a270d-8c84-4eab-bf0b-db384b9b1173 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:48.800743 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-287a270d-8c84-4eab-bf0b-db384b9b1173 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:48.807835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-287a270d-8c84-4eab-bf0b-db384b9b1173 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:48.808612 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-287a270d-8c84-4eab-bf0b-db384b9b1173 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:48.809245 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-287a270d-8c84-4eab-bf0b-db384b9b1173 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:48.810106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-287a270d-8c84-4eab-bf0b-db384b9b1173 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:48.810722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-287a270d-8c84-4eab-bf0b-db384b9b1173 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:48.811469 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-287a270d-8c84-4eab-bf0b-db384b9b1173 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:48.986864 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-287a270d-8c84-4eab-bf0b-db384b9b1173 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:48.995242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-287a270d-8c84-4eab-bf0b-db384b9b1173 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1722 microversion: 2.1 time: 0.200431 Aug 24 16:47:48.995835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 403/814] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:48 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:49.478832 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4d8e73e7-b735-41b1-b802-37d1dc4b7f72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:49.479494 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-4d8e73e7-b735-41b1-b802-37d1dc4b7f72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:49.485961 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4d8e73e7-b735-41b1-b802-37d1dc4b7f72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:49.487175 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4d8e73e7-b735-41b1-b802-37d1dc4b7f72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:49.487618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4d8e73e7-b735-41b1-b802-37d1dc4b7f72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:49.488350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4d8e73e7-b735-41b1-b802-37d1dc4b7f72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:49.488809 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4d8e73e7-b735-41b1-b802-37d1dc4b7f72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:49.489232 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4d8e73e7-b735-41b1-b802-37d1dc4b7f72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:49.574099 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-4d8e73e7-b735-41b1-b802-37d1dc4b7f72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lazy-loading 'services' on Instance uuid 3d552f38-2ddf-4ab9-9879-394b70e69768 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:47:49.654084 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-4d8e73e7-b735-41b1-b802-37d1dc4b7f72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments/031e5b0f-8d13-46ce-b331-a574912be2b8" status: 202 len: 0 microversion: 2.1 time: 0.179344 Aug 24 16:47:49.654778 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 412/815] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:47:49 2022] DELETE /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments/031e5b0f-8d13-46ce-b331-a574912be2b8 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:47:49.663901 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c73b90f9-02b0-4f29-8f5b-57bfc71eba0e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:49.666491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c73b90f9-02b0-4f29-8f5b-57bfc71eba0e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:49.672670 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c73b90f9-02b0-4f29-8f5b-57bfc71eba0e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:49.673162 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c73b90f9-02b0-4f29-8f5b-57bfc71eba0e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:49.674355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c73b90f9-02b0-4f29-8f5b-57bfc71eba0e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:49.675312 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c73b90f9-02b0-4f29-8f5b-57bfc71eba0e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:49.676527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c73b90f9-02b0-4f29-8f5b-57bfc71eba0e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:49.676527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c73b90f9-02b0-4f29-8f5b-57bfc71eba0e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:49.706954 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c73b90f9-02b0-4f29-8f5b-57bfc71eba0e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Aug 24 16:47:49.707528 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 404/816] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:47:49 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:47:50.017990 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7e0521e1-490d-472e-a516-1ef18b5e9318 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:50.018744 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-7e0521e1-490d-472e-a516-1ef18b5e9318 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:50.025009 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e0521e1-490d-472e-a516-1ef18b5e9318 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.025496 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e0521e1-490d-472e-a516-1ef18b5e9318 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.025983 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e0521e1-490d-472e-a516-1ef18b5e9318 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.026709 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e0521e1-490d-472e-a516-1ef18b5e9318 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.027173 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e0521e1-490d-472e-a516-1ef18b5e9318 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.027597 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e0521e1-490d-472e-a516-1ef18b5e9318 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.174528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-7e0521e1-490d-472e-a516-1ef18b5e9318 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:50.183991 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7e0521e1-490d-472e-a516-1ef18b5e9318 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1722 microversion: 2.1 time: 0.170345 Aug 24 16:47:50.184913 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 413/817] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:50 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:50.312106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-c727c613-d85e-4c54-8374-3e284f437be0 req-15637769-9f74-45ca-8da9-fd50a0de8c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d552f38-2ddf-4ab9-9879-394b70e69768", "tag": "96c147e1-5a95-4a34-b8b2-ba69d7923b79"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:50.322307 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-c727c613-d85e-4c54-8374-3e284f437be0 req-15637769-9f74-45ca-8da9-fd50a0de8c85 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.322788 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-c727c613-d85e-4c54-8374-3e284f437be0 req-15637769-9f74-45ca-8da9-fd50a0de8c85 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.323213 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-c727c613-d85e-4c54-8374-3e284f437be0 req-15637769-9f74-45ca-8da9-fd50a0de8c85 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.336194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-c727c613-d85e-4c54-8374-3e284f437be0 req-15637769-9f74-45ca-8da9-fd50a0de8c85 service nova] Creating event network-changed:96c147e1-5a95-4a34-b8b2-ba69d7923b79 for instance 3d552f38-2ddf-4ab9-9879-394b70e69768 on hv-cinder-77957 Aug 24 16:47:50.341101 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-c727c613-d85e-4c54-8374-3e284f437be0 req-15637769-9f74-45ca-8da9-fd50a0de8c85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032717 Aug 24 16:47:50.341907 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 405/818] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:47:50.718916 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-695522ee-2060-4d5b-a3aa-2ae43ef2ad72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:50.721372 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-695522ee-2060-4d5b-a3aa-2ae43ef2ad72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:50.727228 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-695522ee-2060-4d5b-a3aa-2ae43ef2ad72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.727706 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-695522ee-2060-4d5b-a3aa-2ae43ef2ad72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.728185 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-695522ee-2060-4d5b-a3aa-2ae43ef2ad72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.728864 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-695522ee-2060-4d5b-a3aa-2ae43ef2ad72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.729310 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-695522ee-2060-4d5b-a3aa-2ae43ef2ad72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.729727 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-695522ee-2060-4d5b-a3aa-2ae43ef2ad72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.757911 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-695522ee-2060-4d5b-a3aa-2ae43ef2ad72 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043007 Aug 24 16:47:50.758474 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 414/819] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:47:50 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:47:50.770479 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:50.771126 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:50.777241 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.777724 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.778157 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.778901 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:50.779352 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:50.779770 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:50.855478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] HTTP exception thrown: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 is not attached to volume 031e5b0f-8d13-46ce-b331-a574912be2b8 Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Request method failure captured: Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: DELETE /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments/031e5b0f-8d13-46ce-b331-a574912be2b8 HTTP/1.1 Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlW1Fmte1r2bSuEG7KvvuHuwhrmn4LuRxDbI8MwMlGYBMCPauD1GqmQDQWZFkNU0-dulC_7xzkJLVOhLFoHoPVDjFgZDWbmAGSGodBkGXL_AeJMpGGK78qtPGYNG_5ClAJY4-60sB9_KDdqS87u5hFGAsl0LUJstm4lkdul7vA4oYRc Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 00a45ba3e79b425493703f960803cea1 Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-TestMinimumBasicScenario-1879532217 Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:47:50.858002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/00a45ba3e79b425493703f960803cea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/00a45ba3e79b425493703f960803cea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/00a45ba3e79b425493703f960803cea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_00a45ba3e79b425493703f960803cea1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-TestMinimumBasicScenario-1879532217 Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 00a45ba3e79b425493703f960803cea1 Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1879532217 Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-TestMinimumBasicScenario-1879532217-project Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 623e7860c4ee4918b7a917024d35e39b Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-TestMinimumBasicScenario-1879532217-project Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:47:50.859680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 is not attached to volume 031e5b0f-8d13-46ce-b331-a574912be2b8 Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'server_id': '3d552f38-2ddf-4ab9-9879-394b70e69768', 'id': '031e5b0f-8d13-46ce-b331-a574912be2b8'} Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 031e5b0f-8d13-46ce-b331-a574912be2b8. Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:47:50.864429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 is not attached to volume 031e5b0f-8d13-46ce-b331-a574912be2b8 Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 is not attached to volume 031e5b0f-8d13-46ce-b331-a574912be2b8 Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:47:50.866646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Returning 404 to user: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 is not attached to volume 031e5b0f-8d13-46ce-b331-a574912be2b8 {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:47:50.867751 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-39910f7a-36b7-4062-9342-e9e3cd70c48b tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments/031e5b0f-8d13-46ce-b331-a574912be2b8" status: 404 len: 154 microversion: 2.1 time: 0.094347 Aug 24 16:47:50.867751 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 406/820] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:47:50 2022] DELETE /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768/os-volume_attachments/031e5b0f-8d13-46ce-b331-a574912be2b8 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:47:51.206442 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-92071a5b-952a-48f2-94d0-485e47965e0c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:51.207537 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-92071a5b-952a-48f2-94d0-485e47965e0c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:51.214909 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-92071a5b-952a-48f2-94d0-485e47965e0c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:51.215400 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-92071a5b-952a-48f2-94d0-485e47965e0c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:51.215841 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-92071a5b-952a-48f2-94d0-485e47965e0c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:51.216576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-92071a5b-952a-48f2-94d0-485e47965e0c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:51.217036 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-92071a5b-952a-48f2-94d0-485e47965e0c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:51.217467 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-92071a5b-952a-48f2-94d0-485e47965e0c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:51.352283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-92071a5b-952a-48f2-94d0-485e47965e0c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:51.360394 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-92071a5b-952a-48f2-94d0-485e47965e0c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1722 microversion: 2.1 time: 0.158672 Aug 24 16:47:51.360961 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 415/821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:51 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:52.004214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-110e1577-c428-4811-bd92-7f96938a5ab1 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:52.004729 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-110e1577-c428-4811-bd92-7f96938a5ab1 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:52.010905 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-110e1577-c428-4811-bd92-7f96938a5ab1 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:52.011381 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-110e1577-c428-4811-bd92-7f96938a5ab1 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:52.011807 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-110e1577-c428-4811-bd92-7f96938a5ab1 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:52.012516 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-110e1577-c428-4811-bd92-7f96938a5ab1 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:52.012966 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-110e1577-c428-4811-bd92-7f96938a5ab1 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:52.013380 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-110e1577-c428-4811-bd92-7f96938a5ab1 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:52.038906 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-110e1577-c428-4811-bd92-7f96938a5ab1 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:47:52.110618 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-110e1577-c428-4811-bd92-7f96938a5ab1 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 204 len: 0 microversion: 2.1 time: 0.109776 Aug 24 16:47:52.111419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 407/822] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:47:51 2022] DELETE /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:47:52.119538 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e335324b-43b4-4250-830f-ddca16407e9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:52.120180 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e335324b-43b4-4250-830f-ddca16407e9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:52.126003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e335324b-43b4-4250-830f-ddca16407e9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:52.126480 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e335324b-43b4-4250-830f-ddca16407e9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:52.126908 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e335324b-43b4-4250-830f-ddca16407e9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:52.128332 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e335324b-43b4-4250-830f-ddca16407e9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:52.128960 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e335324b-43b4-4250-830f-ddca16407e9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:52.129382 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e335324b-43b4-4250-830f-ddca16407e9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:52.256943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e335324b-43b4-4250-830f-ddca16407e9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:52.264436 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e335324b-43b4-4250-830f-ddca16407e9e tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1554 microversion: 2.1 time: 0.148696 Aug 24 16:47:52.264999 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 416/823] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:52 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:52.383199 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9bb0ffba-2f2f-426c-a939-64d9c5085db5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:52.383965 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9bb0ffba-2f2f-426c-a939-64d9c5085db5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:52.389860 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bb0ffba-2f2f-426c-a939-64d9c5085db5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:52.390341 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bb0ffba-2f2f-426c-a939-64d9c5085db5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:52.390768 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bb0ffba-2f2f-426c-a939-64d9c5085db5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:52.391460 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bb0ffba-2f2f-426c-a939-64d9c5085db5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:52.392207 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bb0ffba-2f2f-426c-a939-64d9c5085db5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:52.392626 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9bb0ffba-2f2f-426c-a939-64d9c5085db5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:52.525463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9bb0ffba-2f2f-426c-a939-64d9c5085db5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:52.533791 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9bb0ffba-2f2f-426c-a939-64d9c5085db5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1722 microversion: 2.1 time: 0.154720 Aug 24 16:47:52.534549 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 408/824] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:52 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:53.286272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c6f988fc-2076-4aed-b21e-bb8e63a9a873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:53.286826 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c6f988fc-2076-4aed-b21e-bb8e63a9a873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:53.293543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6f988fc-2076-4aed-b21e-bb8e63a9a873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.294025 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6f988fc-2076-4aed-b21e-bb8e63a9a873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.294457 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6f988fc-2076-4aed-b21e-bb8e63a9a873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.295144 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6f988fc-2076-4aed-b21e-bb8e63a9a873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.295592 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6f988fc-2076-4aed-b21e-bb8e63a9a873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.296549 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6f988fc-2076-4aed-b21e-bb8e63a9a873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.422455 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c6f988fc-2076-4aed-b21e-bb8e63a9a873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:53.430518 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c6f988fc-2076-4aed-b21e-bb8e63a9a873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1554 microversion: 2.1 time: 0.148172 Aug 24 16:47:53.431088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 417/825] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:53 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:53.557610 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-99bc98f5-a121-46d2-bebf-b6f7a855b301 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:53.558154 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-99bc98f5-a121-46d2-bebf-b6f7a855b301 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:53.564625 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-99bc98f5-a121-46d2-bebf-b6f7a855b301 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.565241 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-99bc98f5-a121-46d2-bebf-b6f7a855b301 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.565686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-99bc98f5-a121-46d2-bebf-b6f7a855b301 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.566376 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-99bc98f5-a121-46d2-bebf-b6f7a855b301 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:53.566836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-99bc98f5-a121-46d2-bebf-b6f7a855b301 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:53.567263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-99bc98f5-a121-46d2-bebf-b6f7a855b301 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:53.707635 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-99bc98f5-a121-46d2-bebf-b6f7a855b301 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:53.715789 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-99bc98f5-a121-46d2-bebf-b6f7a855b301 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1722 microversion: 2.1 time: 0.162192 Aug 24 16:47:53.716378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 409/826] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:53 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:54.450742 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0c8b1293-70fa-435f-896d-874a7a91c873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:54.451520 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0c8b1293-70fa-435f-896d-874a7a91c873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:54.458375 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c8b1293-70fa-435f-896d-874a7a91c873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.458866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c8b1293-70fa-435f-896d-874a7a91c873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.459302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c8b1293-70fa-435f-896d-874a7a91c873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.460045 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c8b1293-70fa-435f-896d-874a7a91c873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.460646 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c8b1293-70fa-435f-896d-874a7a91c873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.460953 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0c8b1293-70fa-435f-896d-874a7a91c873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.485723 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-dd4b9b9f-3b00-40d9-ba9a-4a07b25ae83f req-8baa4ba8-95b9-429c-b891-d1e2375c1198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d552f38-2ddf-4ab9-9879-394b70e69768", "name": "network-vif-deleted", "tag": "96c147e1-5a95-4a34-b8b2-ba69d7923b79"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:54.495413 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-dd4b9b9f-3b00-40d9-ba9a-4a07b25ae83f req-8baa4ba8-95b9-429c-b891-d1e2375c1198 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.495902 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-dd4b9b9f-3b00-40d9-ba9a-4a07b25ae83f req-8baa4ba8-95b9-429c-b891-d1e2375c1198 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.496357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-dd4b9b9f-3b00-40d9-ba9a-4a07b25ae83f req-8baa4ba8-95b9-429c-b891-d1e2375c1198 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.509115 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-dd4b9b9f-3b00-40d9-ba9a-4a07b25ae83f req-8baa4ba8-95b9-429c-b891-d1e2375c1198 service nova] Creating event network-vif-deleted:96c147e1-5a95-4a34-b8b2-ba69d7923b79 for instance 3d552f38-2ddf-4ab9-9879-394b70e69768 on hv-cinder-77957 Aug 24 16:47:54.514477 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-dd4b9b9f-3b00-40d9-ba9a-4a07b25ae83f req-8baa4ba8-95b9-429c-b891-d1e2375c1198 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032383 Aug 24 16:47:54.515378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 410/827] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:47:54.529547 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-0c8b1293-70fa-435f-896d-874a7a91c873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '623e7860c4ee4918b7a917024d35e39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a45ba3e79b425493703f960803cea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:54.539449 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0c8b1293-70fa-435f-896d-874a7a91c873 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 200 len: 1512 microversion: 2.1 time: 0.092391 Aug 24 16:47:54.549261 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 418/828] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:54 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:54.738868 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-765ac8e5-960c-4661-b27a-a607ef0d0362 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:54.739494 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-765ac8e5-960c-4661-b27a-a607ef0d0362 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:54.745710 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-765ac8e5-960c-4661-b27a-a607ef0d0362 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.746195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-765ac8e5-960c-4661-b27a-a607ef0d0362 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.746641 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-765ac8e5-960c-4661-b27a-a607ef0d0362 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.747342 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-765ac8e5-960c-4661-b27a-a607ef0d0362 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:54.747804 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-765ac8e5-960c-4661-b27a-a607ef0d0362 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:54.748253 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-765ac8e5-960c-4661-b27a-a607ef0d0362 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:54.753173 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:54.890596 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-765ac8e5-960c-4661-b27a-a607ef0d0362 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:54.901496 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-765ac8e5-960c-4661-b27a-a607ef0d0362 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1722 microversion: 2.1 time: 0.167839 Aug 24 16:47:54.902519 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 411/829] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:54 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:55.561652 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:55.562258 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] [instance: 3d552f38-2ddf-4ab9-9879-394b70e69768] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:55.569381 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:55.569860 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:55.570291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:55.570977 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:55.571430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:55.571858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:55.586150 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] HTTP exception thrown: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 could not be found. Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Request method failure captured: Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 HTTP/1.1 Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlW1Fmte1r2bSuEG7KvvuHuwhrmn4LuRxDbI8MwMlGYBMCPauD1GqmQDQWZFkNU0-dulC_7xzkJLVOhLFoHoPVDjFgZDWbmAGSGodBkGXL_AeJMpGGK78qtPGYNG_5ClAJY4-60sB9_KDdqS87u5hFGAsl0LUJstm4lkdul7vA4oYRc Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 00a45ba3e79b425493703f960803cea1 Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-TestMinimumBasicScenario-1879532217 Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:47:55.587756 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/00a45ba3e79b425493703f960803cea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/00a45ba3e79b425493703f960803cea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/00a45ba3e79b425493703f960803cea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_00a45ba3e79b425493703f960803cea1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-TestMinimumBasicScenario-1879532217 Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 00a45ba3e79b425493703f960803cea1 Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1879532217 Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-TestMinimumBasicScenario-1879532217-project Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 623e7860c4ee4918b7a917024d35e39b Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-TestMinimumBasicScenario-1879532217-project Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 could not be found. Aug 24 16:47:55.589336 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '3d552f38-2ddf-4ab9-9879-394b70e69768'} Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 could not be found. Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:47:55.590266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 could not be found. Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 could not be found. Aug 24 16:47:55.591595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:47:55.592880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Returning 404 to user: Instance 3d552f38-2ddf-4ab9-9879-394b70e69768 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:47:55.592880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6af7dadc-f368-44c4-badf-4772ff868da2 tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768" status: 404 len: 111 microversion: 2.1 time: 0.031393 Aug 24 16:47:55.592880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 419/830] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:55 2022] GET /compute/v2.1/servers/3d552f38-2ddf-4ab9-9879-394b70e69768 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:47:55.597884 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f311a2d3-22f4-443a-bbff-ee1873f76b2f tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] Calling method '.version_select at 0x7f063a9c9e50>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:55.616802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f311a2d3-22f4-443a-bbff-ee1873f76b2f tempest-TestMinimumBasicScenario-1879532217 tempest-TestMinimumBasicScenario-1879532217-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1791929583" status: 202 len: 0 microversion: 2.1 time: 0.022807 Aug 24 16:47:55.617354 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 412/831] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Aug 24 16:47:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1791929583 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:47:55.922419 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-09572092-bd9a-44bf-8717-7e940eed1eef tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:55.923019 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-09572092-bd9a-44bf-8717-7e940eed1eef tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:55.929606 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09572092-bd9a-44bf-8717-7e940eed1eef tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:55.930097 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09572092-bd9a-44bf-8717-7e940eed1eef tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:55.930577 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09572092-bd9a-44bf-8717-7e940eed1eef tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:55.931188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09572092-bd9a-44bf-8717-7e940eed1eef tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:55.931635 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09572092-bd9a-44bf-8717-7e940eed1eef tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:55.932080 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09572092-bd9a-44bf-8717-7e940eed1eef tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:56.077054 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-09572092-bd9a-44bf-8717-7e940eed1eef tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:56.086064 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-09572092-bd9a-44bf-8717-7e940eed1eef tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1722 microversion: 2.1 time: 0.167403 Aug 24 16:47:56.086636 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 420/832] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:55 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:57.108975 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-13cc2bac-69f5-4a33-a70e-d6fc18c7cc39 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:57.109607 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-13cc2bac-69f5-4a33-a70e-d6fc18c7cc39 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:57.117365 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-13cc2bac-69f5-4a33-a70e-d6fc18c7cc39 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.118202 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-13cc2bac-69f5-4a33-a70e-d6fc18c7cc39 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.118791 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-13cc2bac-69f5-4a33-a70e-d6fc18c7cc39 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.119741 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-13cc2bac-69f5-4a33-a70e-d6fc18c7cc39 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.120489 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-13cc2bac-69f5-4a33-a70e-d6fc18c7cc39 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.120910 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-13cc2bac-69f5-4a33-a70e-d6fc18c7cc39 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.392435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-13cc2bac-69f5-4a33-a70e-d6fc18c7cc39 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:57.401266 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-13cc2bac-69f5-4a33-a70e-d6fc18c7cc39 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1699 microversion: 2.1 time: 0.296682 Aug 24 16:47:57.401827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 413/833] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:57 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1699 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:57.421564 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4f4edeef-ec5f-44da-9fb6-5045b33d70ec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:47:57.428168 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4f4edeef-ec5f-44da-9fb6-5045b33d70ec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.428668 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4f4edeef-ec5f-44da-9fb6-5045b33d70ec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.429106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4f4edeef-ec5f-44da-9fb6-5045b33d70ec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.451210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-4f4edeef-ec5f-44da-9fb6-5045b33d70ec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Going to try to start instance {{(pid=127166) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 16:47:57.456397 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:57.495310 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-4f4edeef-ec5f-44da-9fb6-5045b33d70ec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.077298 Aug 24 16:47:57.496018 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 421/834] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:47:57 2022] POST /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:47:57.505027 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9d0c84f2-a769-4cb5-b408-0cf433783e52 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:57.505646 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9d0c84f2-a769-4cb5-b408-0cf433783e52 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:57.511820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d0c84f2-a769-4cb5-b408-0cf433783e52 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.512392 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d0c84f2-a769-4cb5-b408-0cf433783e52 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.512875 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d0c84f2-a769-4cb5-b408-0cf433783e52 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.513630 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d0c84f2-a769-4cb5-b408-0cf433783e52 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:57.514118 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d0c84f2-a769-4cb5-b408-0cf433783e52 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:57.514550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d0c84f2-a769-4cb5-b408-0cf433783e52 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:57.742618 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9d0c84f2-a769-4cb5-b408-0cf433783e52 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:57.754477 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9d0c84f2-a769-4cb5-b408-0cf433783e52 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1708 microversion: 2.1 time: 0.254072 Aug 24 16:47:57.758750 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 414/835] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:57 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1708 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:47:58.778534 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3ebd8ae2-ddf8-4ef1-913b-6f3d23e68de7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:47:58.779224 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3ebd8ae2-ddf8-4ef1-913b-6f3d23e68de7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:47:58.788032 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3ebd8ae2-ddf8-4ef1-913b-6f3d23e68de7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:58.788549 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3ebd8ae2-ddf8-4ef1-913b-6f3d23e68de7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:58.788982 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3ebd8ae2-ddf8-4ef1-913b-6f3d23e68de7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:58.789687 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3ebd8ae2-ddf8-4ef1-913b-6f3d23e68de7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:47:58.790135 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3ebd8ae2-ddf8-4ef1-913b-6f3d23e68de7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:47:58.790557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3ebd8ae2-ddf8-4ef1-913b-6f3d23e68de7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:47:59.004058 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-3ebd8ae2-ddf8-4ef1-913b-6f3d23e68de7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:47:59.012198 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3ebd8ae2-ddf8-4ef1-913b-6f3d23e68de7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1708 microversion: 2.1 time: 0.237909 Aug 24 16:47:59.012769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 422/836] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:47:58 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1708 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:00.035934 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a73bd9e0-a7e6-4bc7-945c-8399d1f0d2ff tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:00.036675 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a73bd9e0-a7e6-4bc7-945c-8399d1f0d2ff tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:00.043392 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a73bd9e0-a7e6-4bc7-945c-8399d1f0d2ff tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.043968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a73bd9e0-a7e6-4bc7-945c-8399d1f0d2ff tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.044491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a73bd9e0-a7e6-4bc7-945c-8399d1f0d2ff tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.045197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a73bd9e0-a7e6-4bc7-945c-8399d1f0d2ff tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:00.045654 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a73bd9e0-a7e6-4bc7-945c-8399d1f0d2ff tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:00.046081 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a73bd9e0-a7e6-4bc7-945c-8399d1f0d2ff tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:00.180872 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-a73bd9e0-a7e6-4bc7-945c-8399d1f0d2ff tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:00.189924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a73bd9e0-a7e6-4bc7-945c-8399d1f0d2ff tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1708 microversion: 2.1 time: 0.159403 Aug 24 16:48:00.190633 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 415/837] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:00 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:01.211914 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3a62fa5c-715d-4458-8ae2-e32c9803e97a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:01.212557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3a62fa5c-715d-4458-8ae2-e32c9803e97a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:01.218519 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3a62fa5c-715d-4458-8ae2-e32c9803e97a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:01.219008 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3a62fa5c-715d-4458-8ae2-e32c9803e97a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:01.219454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3a62fa5c-715d-4458-8ae2-e32c9803e97a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:01.220176 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3a62fa5c-715d-4458-8ae2-e32c9803e97a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:01.221154 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3a62fa5c-715d-4458-8ae2-e32c9803e97a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:01.221773 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3a62fa5c-715d-4458-8ae2-e32c9803e97a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:01.370681 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-3a62fa5c-715d-4458-8ae2-e32c9803e97a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:01.380341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3a62fa5c-715d-4458-8ae2-e32c9803e97a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1708 microversion: 2.1 time: 0.172253 Aug 24 16:48:01.380923 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 423/838] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:01 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1708 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:02.406308 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6e84d466-8ebe-4e60-a891-47480882af75 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:02.406932 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6e84d466-8ebe-4e60-a891-47480882af75 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:02.414987 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e84d466-8ebe-4e60-a891-47480882af75 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:02.415805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e84d466-8ebe-4e60-a891-47480882af75 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:02.416539 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e84d466-8ebe-4e60-a891-47480882af75 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:02.417474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e84d466-8ebe-4e60-a891-47480882af75 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:02.418139 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e84d466-8ebe-4e60-a891-47480882af75 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:02.418817 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6e84d466-8ebe-4e60-a891-47480882af75 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:02.586510 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6e84d466-8ebe-4e60-a891-47480882af75 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:02.597009 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6e84d466-8ebe-4e60-a891-47480882af75 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1712 microversion: 2.1 time: 0.198420 Aug 24 16:48:02.598221 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 416/839] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:02 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1712 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:05.114141 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1226531632", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1832399109", "security_groups": [{"name": "tempest-secgroup-smoke-1681464898"}], "block_device_mapping_v2": [{"uuid": "24d6edeb-10cc-45ba-808e-009a2cada230", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3e014ccf-9e98-4c79-acd6-45f0ecc3f7d2"}]}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:05.225103 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] validate_networks() for [('3e014ccf-9e98-4c79-acd6-45f0ecc3f7d2', None, None, None, None, None)] {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:48:05.407124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:05.598510 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:48:05.598928 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:48:05.599393 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:48:05.599797 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:48:05.600238 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:48:05.608931 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:05.609410 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:05.609839 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:05.610559 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:05.611012 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:05.611925 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:05.629999 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Getting quotas for project 7c99de6ca9094fa7bd119a3be6817725. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:48:05.633894 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Getting quotas for user bb5d3834f04142e288c04cc05665329f and project 7c99de6ca9094fa7bd119a3be6817725. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:48:05.691029 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:48:05.693176 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24d6edeb-10cc-45ba-808e-009a2cada230',volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:48:05.832668 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5b1100ac-e4c6-4c7f-a8ce-e3430d5951f3 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723604 Aug 24 16:48:05.833525 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 424/840] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:48:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:48:05.844080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0af16de7-170f-4637-80b9-a813ad74a68c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:05.844692 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0af16de7-170f-4637-80b9-a813ad74a68c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:05.847571 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:05.902922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-0af16de7-170f-4637-80b9-a813ad74a68c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:05.910384 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0af16de7-170f-4637-80b9-a813ad74a68c tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1095 microversion: 2.1 time: 0.070162 Aug 24 16:48:05.910959 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 417/841] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:05 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:06.932587 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-3f02129f-741c-433c-b694-a12c0c73ecf7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:06.933226 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-3f02129f-741c-433c-b694-a12c0c73ecf7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:06.939315 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f02129f-741c-433c-b694-a12c0c73ecf7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:06.939801 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f02129f-741c-433c-b694-a12c0c73ecf7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:06.940855 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f02129f-741c-433c-b694-a12c0c73ecf7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:06.941738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f02129f-741c-433c-b694-a12c0c73ecf7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:06.942191 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f02129f-741c-433c-b694-a12c0c73ecf7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:06.942613 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-3f02129f-741c-433c-b694-a12c0c73ecf7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:07.016134 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-3f02129f-741c-433c-b694-a12c0c73ecf7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:07.024476 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-3f02129f-741c-433c-b694-a12c0c73ecf7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1211 microversion: 2.1 time: 0.096680 Aug 24 16:48:07.025173 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 425/842] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:06 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:08.045685 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2dd52fa0-36b1-4115-be6a-b0c07b76f6af tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:08.046301 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2dd52fa0-36b1-4115-be6a-b0c07b76f6af tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:08.054194 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2dd52fa0-36b1-4115-be6a-b0c07b76f6af tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.054672 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2dd52fa0-36b1-4115-be6a-b0c07b76f6af tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.055111 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2dd52fa0-36b1-4115-be6a-b0c07b76f6af tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.055814 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2dd52fa0-36b1-4115-be6a-b0c07b76f6af tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.056299 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2dd52fa0-36b1-4115-be6a-b0c07b76f6af tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.056730 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2dd52fa0-36b1-4115-be6a-b0c07b76f6af tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.193120 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2dd52fa0-36b1-4115-be6a-b0c07b76f6af tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:08.201925 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2dd52fa0-36b1-4115-be6a-b0c07b76f6af tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.160022 Aug 24 16:48:08.202423 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 418/843] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:08 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:08.374938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-07094a31-a9fc-4774-8fc6-d71e398237ef req-85a96908-aeb7-4e5f-8b67-89e92e268b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402e30ca-e4f0-41a7-be41-890f9356d7de", "tag": "793907c0-b739-4a8a-9006-bb1625d3baa2"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:08.386370 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-07094a31-a9fc-4774-8fc6-d71e398237ef req-85a96908-aeb7-4e5f-8b67-89e92e268b38 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:08.386852 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-07094a31-a9fc-4774-8fc6-d71e398237ef req-85a96908-aeb7-4e5f-8b67-89e92e268b38 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:08.387357 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-07094a31-a9fc-4774-8fc6-d71e398237ef req-85a96908-aeb7-4e5f-8b67-89e92e268b38 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:08.399358 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-07094a31-a9fc-4774-8fc6-d71e398237ef req-85a96908-aeb7-4e5f-8b67-89e92e268b38 service nova] Creating event network-changed:793907c0-b739-4a8a-9006-bb1625d3baa2 for instance 402e30ca-e4f0-41a7-be41-890f9356d7de on hv-cinder-77957 Aug 24 16:48:08.404264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-07094a31-a9fc-4774-8fc6-d71e398237ef req-85a96908-aeb7-4e5f-8b67-89e92e268b38 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032948 Aug 24 16:48:08.404864 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 426/844] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:09.223502 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9d12d3b5-ec91-44aa-aa93-db2a512a373b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:09.224164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9d12d3b5-ec91-44aa-aa93-db2a512a373b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:09.230437 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d12d3b5-ec91-44aa-aa93-db2a512a373b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:09.230917 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d12d3b5-ec91-44aa-aa93-db2a512a373b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:09.231343 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d12d3b5-ec91-44aa-aa93-db2a512a373b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:09.232049 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d12d3b5-ec91-44aa-aa93-db2a512a373b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:09.232500 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d12d3b5-ec91-44aa-aa93-db2a512a373b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:09.232914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9d12d3b5-ec91-44aa-aa93-db2a512a373b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:09.365377 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9d12d3b5-ec91-44aa-aa93-db2a512a373b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:09.373295 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9d12d3b5-ec91-44aa-aa93-db2a512a373b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.154477 Aug 24 16:48:09.373868 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 419/845] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:09 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:10.396744 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e5ad5d46-c65d-471b-9ebf-7639f1c7c311 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:10.397430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e5ad5d46-c65d-471b-9ebf-7639f1c7c311 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:10.403486 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5ad5d46-c65d-471b-9ebf-7639f1c7c311 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:10.403989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5ad5d46-c65d-471b-9ebf-7639f1c7c311 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:10.404422 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5ad5d46-c65d-471b-9ebf-7639f1c7c311 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:10.405102 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5ad5d46-c65d-471b-9ebf-7639f1c7c311 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:10.405550 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5ad5d46-c65d-471b-9ebf-7639f1c7c311 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:10.405969 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e5ad5d46-c65d-471b-9ebf-7639f1c7c311 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:10.550982 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e5ad5d46-c65d-471b-9ebf-7639f1c7c311 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:10.558546 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e5ad5d46-c65d-471b-9ebf-7639f1c7c311 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.166338 Aug 24 16:48:10.559100 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 427/846] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:10 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:11.578956 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ac2cffc2-0e89-46e9-a661-4489d2c409c7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:11.579558 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ac2cffc2-0e89-46e9-a661-4489d2c409c7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:11.586124 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ac2cffc2-0e89-46e9-a661-4489d2c409c7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:11.586613 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ac2cffc2-0e89-46e9-a661-4489d2c409c7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:11.587082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ac2cffc2-0e89-46e9-a661-4489d2c409c7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:11.587777 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ac2cffc2-0e89-46e9-a661-4489d2c409c7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:11.588263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ac2cffc2-0e89-46e9-a661-4489d2c409c7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:11.588692 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ac2cffc2-0e89-46e9-a661-4489d2c409c7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:11.717424 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ac2cffc2-0e89-46e9-a661-4489d2c409c7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:11.725672 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ac2cffc2-0e89-46e9-a661-4489d2c409c7 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.150668 Aug 24 16:48:11.726237 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 420/847] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:11 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:12.747262 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-58b48396-f0d8-40c3-800b-585bb50238a9 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:12.747864 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-58b48396-f0d8-40c3-800b-585bb50238a9 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:12.754878 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-58b48396-f0d8-40c3-800b-585bb50238a9 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:12.755352 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-58b48396-f0d8-40c3-800b-585bb50238a9 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:12.755799 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-58b48396-f0d8-40c3-800b-585bb50238a9 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:12.756487 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-58b48396-f0d8-40c3-800b-585bb50238a9 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:12.756931 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-58b48396-f0d8-40c3-800b-585bb50238a9 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:12.757344 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-58b48396-f0d8-40c3-800b-585bb50238a9 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:12.890369 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-58b48396-f0d8-40c3-800b-585bb50238a9 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:12.899649 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-58b48396-f0d8-40c3-800b-585bb50238a9 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.155644 Aug 24 16:48:12.900256 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 428/848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:12 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:13.919822 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-555a6733-98d1-4ef0-bf91-6b2ad3c27f5e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:13.920519 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-555a6733-98d1-4ef0-bf91-6b2ad3c27f5e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:13.926810 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-555a6733-98d1-4ef0-bf91-6b2ad3c27f5e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:13.927289 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-555a6733-98d1-4ef0-bf91-6b2ad3c27f5e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:13.927713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-555a6733-98d1-4ef0-bf91-6b2ad3c27f5e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:13.928432 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-555a6733-98d1-4ef0-bf91-6b2ad3c27f5e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:13.928886 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-555a6733-98d1-4ef0-bf91-6b2ad3c27f5e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:13.929298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-555a6733-98d1-4ef0-bf91-6b2ad3c27f5e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:14.061222 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-555a6733-98d1-4ef0-bf91-6b2ad3c27f5e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:14.069325 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-555a6733-98d1-4ef0-bf91-6b2ad3c27f5e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.153395 Aug 24 16:48:14.069878 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 421/849] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:13 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:15.090365 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d05f8641-6682-4783-bb2b-63bef57e990d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:15.090968 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d05f8641-6682-4783-bb2b-63bef57e990d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:15.097671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d05f8641-6682-4783-bb2b-63bef57e990d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:15.098068 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d05f8641-6682-4783-bb2b-63bef57e990d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:15.098499 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d05f8641-6682-4783-bb2b-63bef57e990d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:15.099191 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d05f8641-6682-4783-bb2b-63bef57e990d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:15.099641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d05f8641-6682-4783-bb2b-63bef57e990d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:15.100115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d05f8641-6682-4783-bb2b-63bef57e990d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:15.233449 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d05f8641-6682-4783-bb2b-63bef57e990d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:15.241123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d05f8641-6682-4783-bb2b-63bef57e990d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.154575 Aug 24 16:48:15.241693 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 429/850] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:15 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:16.262009 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-50d98b6a-fe66-41f0-aaef-e656af048acf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:16.262615 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-50d98b6a-fe66-41f0-aaef-e656af048acf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:16.264861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:16.270637 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50d98b6a-fe66-41f0-aaef-e656af048acf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:16.271117 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50d98b6a-fe66-41f0-aaef-e656af048acf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:16.271545 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50d98b6a-fe66-41f0-aaef-e656af048acf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:16.272278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50d98b6a-fe66-41f0-aaef-e656af048acf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:16.272726 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50d98b6a-fe66-41f0-aaef-e656af048acf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:16.273142 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-50d98b6a-fe66-41f0-aaef-e656af048acf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:16.404249 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-50d98b6a-fe66-41f0-aaef-e656af048acf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:16.412561 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-50d98b6a-fe66-41f0-aaef-e656af048acf tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.154335 Aug 24 16:48:16.413225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 422/851] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:16 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:17.433599 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c6566b2e-53fb-4c03-bab5-8f29cd72594d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:17.434211 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c6566b2e-53fb-4c03-bab5-8f29cd72594d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:17.436424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:17.437083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=6 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:17.444233 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6566b2e-53fb-4c03-bab5-8f29cd72594d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.444732 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6566b2e-53fb-4c03-bab5-8f29cd72594d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.445165 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6566b2e-53fb-4c03-bab5-8f29cd72594d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.445868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6566b2e-53fb-4c03-bab5-8f29cd72594d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:17.446324 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6566b2e-53fb-4c03-bab5-8f29cd72594d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:17.446746 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c6566b2e-53fb-4c03-bab5-8f29cd72594d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:17.584469 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c6566b2e-53fb-4c03-bab5-8f29cd72594d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:17.592278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c6566b2e-53fb-4c03-bab5-8f29cd72594d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.162553 Aug 24 16:48:17.592855 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 430/852] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:17 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:18.613426 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-48bf94ed-5fc0-4c07-93c9-9a2d47ab09a0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:18.614050 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-48bf94ed-5fc0-4c07-93c9-9a2d47ab09a0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:18.620415 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bf94ed-5fc0-4c07-93c9-9a2d47ab09a0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:18.620893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bf94ed-5fc0-4c07-93c9-9a2d47ab09a0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:18.621322 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bf94ed-5fc0-4c07-93c9-9a2d47ab09a0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:18.622002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bf94ed-5fc0-4c07-93c9-9a2d47ab09a0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:18.622446 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bf94ed-5fc0-4c07-93c9-9a2d47ab09a0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:18.622862 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-48bf94ed-5fc0-4c07-93c9-9a2d47ab09a0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:18.757700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-48bf94ed-5fc0-4c07-93c9-9a2d47ab09a0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:18.765328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-48bf94ed-5fc0-4c07-93c9-9a2d47ab09a0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.155778 Aug 24 16:48:18.766138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 423/853] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:18 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:19.381521 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-6b40b319-f973-47e9-bd22-ad37400d70c2 req-07c3c3c7-683a-4819-a25d-23e1b72cfd66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "402e30ca-e4f0-41a7-be41-890f9356d7de", "name": "network-vif-plugged", "status": "completed", "tag": "793907c0-b739-4a8a-9006-bb1625d3baa2"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:19.391141 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-6b40b319-f973-47e9-bd22-ad37400d70c2 req-07c3c3c7-683a-4819-a25d-23e1b72cfd66 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:19.391631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-6b40b319-f973-47e9-bd22-ad37400d70c2 req-07c3c3c7-683a-4819-a25d-23e1b72cfd66 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:19.392094 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-6b40b319-f973-47e9-bd22-ad37400d70c2 req-07c3c3c7-683a-4819-a25d-23e1b72cfd66 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:19.403253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-6b40b319-f973-47e9-bd22-ad37400d70c2 req-07c3c3c7-683a-4819-a25d-23e1b72cfd66 service nova] Creating event network-vif-plugged:793907c0-b739-4a8a-9006-bb1625d3baa2 for instance 402e30ca-e4f0-41a7-be41-890f9356d7de on hv-cinder-77957 Aug 24 16:48:19.408160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-6b40b319-f973-47e9-bd22-ad37400d70c2 req-07c3c3c7-683a-4819-a25d-23e1b72cfd66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030318 Aug 24 16:48:19.409442 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 431/854] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:19.786701 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2115225e-c98a-49a4-995d-79d6c9fad98f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:19.787263 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2115225e-c98a-49a4-995d-79d6c9fad98f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:19.793162 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2115225e-c98a-49a4-995d-79d6c9fad98f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:19.793663 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2115225e-c98a-49a4-995d-79d6c9fad98f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:19.794081 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2115225e-c98a-49a4-995d-79d6c9fad98f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:19.794778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2115225e-c98a-49a4-995d-79d6c9fad98f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:19.795236 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2115225e-c98a-49a4-995d-79d6c9fad98f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:19.795660 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2115225e-c98a-49a4-995d-79d6c9fad98f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:19.924921 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2115225e-c98a-49a4-995d-79d6c9fad98f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:19.932535 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2115225e-c98a-49a4-995d-79d6c9fad98f tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.150519 Aug 24 16:48:19.933100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 424/855] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:19 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:20.954022 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-efc579a3-f8c7-41cf-8af8-34a102f5caba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:20.954710 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-efc579a3-f8c7-41cf-8af8-34a102f5caba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:20.961136 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-efc579a3-f8c7-41cf-8af8-34a102f5caba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.961612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-efc579a3-f8c7-41cf-8af8-34a102f5caba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.962041 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-efc579a3-f8c7-41cf-8af8-34a102f5caba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:20.962719 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-efc579a3-f8c7-41cf-8af8-34a102f5caba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:20.963164 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-efc579a3-f8c7-41cf-8af8-34a102f5caba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:20.963584 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-efc579a3-f8c7-41cf-8af8-34a102f5caba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:21.100345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-efc579a3-f8c7-41cf-8af8-34a102f5caba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:21.108020 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-efc579a3-f8c7-41cf-8af8-34a102f5caba tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1267 microversion: 2.1 time: 0.158201 Aug 24 16:48:21.108594 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 432/856] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:20 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:22.129523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ee8ca14f-2c0e-4193-8d51-3eeb05b97c3b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:22.130141 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ee8ca14f-2c0e-4193-8d51-3eeb05b97c3b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:22.136674 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee8ca14f-2c0e-4193-8d51-3eeb05b97c3b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.137164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee8ca14f-2c0e-4193-8d51-3eeb05b97c3b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.137605 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee8ca14f-2c0e-4193-8d51-3eeb05b97c3b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.138298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee8ca14f-2c0e-4193-8d51-3eeb05b97c3b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.138755 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee8ca14f-2c0e-4193-8d51-3eeb05b97c3b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.139182 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ee8ca14f-2c0e-4193-8d51-3eeb05b97c3b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.268247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ee8ca14f-2c0e-4193-8d51-3eeb05b97c3b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:22.276769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ee8ca14f-2c0e-4193-8d51-3eeb05b97c3b tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1452 microversion: 2.1 time: 0.151308 Aug 24 16:48:22.277339 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 425/857] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:22 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:22.296350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-33a4cbc0-6fcc-4c86-b78a-2ee4655e2e85 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:22.296895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-33a4cbc0-6fcc-4c86-b78a-2ee4655e2e85 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:22.303189 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-33a4cbc0-6fcc-4c86-b78a-2ee4655e2e85 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.303671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-33a4cbc0-6fcc-4c86-b78a-2ee4655e2e85 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.304148 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-33a4cbc0-6fcc-4c86-b78a-2ee4655e2e85 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.304836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-33a4cbc0-6fcc-4c86-b78a-2ee4655e2e85 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:22.305290 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-33a4cbc0-6fcc-4c86-b78a-2ee4655e2e85 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:22.305712 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-33a4cbc0-6fcc-4c86-b78a-2ee4655e2e85 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:22.436329 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-33a4cbc0-6fcc-4c86-b78a-2ee4655e2e85 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:22.444535 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-33a4cbc0-6fcc-4c86-b78a-2ee4655e2e85 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1452 microversion: 2.1 time: 0.151993 Aug 24 16:48:22.445103 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 433/858] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:22 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:24.004885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-6a20daa6-888c-4175-88d5-df614c4ca3e2 req-89f289e5-8d66-45b9-b413-f0b073517bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402e30ca-e4f0-41a7-be41-890f9356d7de", "tag": "793907c0-b739-4a8a-9006-bb1625d3baa2"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:24.014781 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6a20daa6-888c-4175-88d5-df614c4ca3e2 req-89f289e5-8d66-45b9-b413-f0b073517bf1 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:24.015328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6a20daa6-888c-4175-88d5-df614c4ca3e2 req-89f289e5-8d66-45b9-b413-f0b073517bf1 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:24.016121 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-6a20daa6-888c-4175-88d5-df614c4ca3e2 req-89f289e5-8d66-45b9-b413-f0b073517bf1 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:24.029537 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-6a20daa6-888c-4175-88d5-df614c4ca3e2 req-89f289e5-8d66-45b9-b413-f0b073517bf1 service nova] Creating event network-changed:793907c0-b739-4a8a-9006-bb1625d3baa2 for instance 402e30ca-e4f0-41a7-be41-890f9356d7de on hv-cinder-77957 Aug 24 16:48:24.035599 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-6a20daa6-888c-4175-88d5-df614c4ca3e2 req-89f289e5-8d66-45b9-b413-f0b073517bf1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034686 Aug 24 16:48:24.036599 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 426/859] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:48:35.529815 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f4378d23-140b-4a3b-ab9d-b3625a0c3ecd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:35.530354 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f4378d23-140b-4a3b-ab9d-b3625a0c3ecd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:35.532432 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:35.533124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:35.539556 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4378d23-140b-4a3b-ab9d-b3625a0c3ecd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.540120 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4378d23-140b-4a3b-ab9d-b3625a0c3ecd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.540609 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4378d23-140b-4a3b-ab9d-b3625a0c3ecd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.541345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4378d23-140b-4a3b-ab9d-b3625a0c3ecd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:35.541866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4378d23-140b-4a3b-ab9d-b3625a0c3ecd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:35.542304 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f4378d23-140b-4a3b-ab9d-b3625a0c3ecd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:35.621754 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-f4378d23-140b-4a3b-ab9d-b3625a0c3ecd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lazy-loading 'services' on Instance uuid c945bfc4-12ec-45eb-83b6-9e1c55d54e0e {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:48:35.695895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f4378d23-140b-4a3b-ab9d-b3625a0c3ecd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/os-volume_attachments/fe2d86ed-2d68-48dc-bea7-356a74f3d481" status: 202 len: 0 microversion: 2.1 time: 0.169935 Aug 24 16:48:35.696554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 434/860] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:48:35 2022] DELETE /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/os-volume_attachments/fe2d86ed-2d68-48dc-bea7-356a74f3d481 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:48:36.816649 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-3c3443b0-a286-4724-8fe7-2d18cfd52faa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:36.819237 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=21 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:36.820045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=78 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:36.825590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3c3443b0-a286-4724-8fe7-2d18cfd52faa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:36.826097 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3c3443b0-a286-4724-8fe7-2d18cfd52faa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:36.826521 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3c3443b0-a286-4724-8fe7-2d18cfd52faa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:36.884225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-3c3443b0-a286-4724-8fe7-2d18cfd52faa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Going to try to stop instance {{(pid=127165) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 16:48:36.926006 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-3c3443b0-a286-4724-8fe7-2d18cfd52faa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.113362 Aug 24 16:48:36.926609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 427/861] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:48:36 2022] POST /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:48:36.935179 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-be669868-7727-4e87-bd87-3658aa6679fa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:36.935979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-be669868-7727-4e87-bd87-3658aa6679fa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:36.943068 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be669868-7727-4e87-bd87-3658aa6679fa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:36.943548 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be669868-7727-4e87-bd87-3658aa6679fa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:36.944087 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be669868-7727-4e87-bd87-3658aa6679fa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:36.944708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be669868-7727-4e87-bd87-3658aa6679fa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:36.945156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be669868-7727-4e87-bd87-3658aa6679fa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:36.945652 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-be669868-7727-4e87-bd87-3658aa6679fa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:37.084318 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-be669868-7727-4e87-bd87-3658aa6679fa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:37.091965 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-be669868-7727-4e87-bd87-3658aa6679fa tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1676 microversion: 2.1 time: 0.160962 Aug 24 16:48:37.092517 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 435/862] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:36 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:38.115620 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9be1bf82-b53a-4826-b8bd-4e2f5a8f0bda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:38.116341 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9be1bf82-b53a-4826-b8bd-4e2f5a8f0bda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:38.122609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9be1bf82-b53a-4826-b8bd-4e2f5a8f0bda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:38.123100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9be1bf82-b53a-4826-b8bd-4e2f5a8f0bda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:38.123535 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9be1bf82-b53a-4826-b8bd-4e2f5a8f0bda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:38.124250 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9be1bf82-b53a-4826-b8bd-4e2f5a8f0bda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:38.124716 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9be1bf82-b53a-4826-b8bd-4e2f5a8f0bda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:38.125135 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9be1bf82-b53a-4826-b8bd-4e2f5a8f0bda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:38.258691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9be1bf82-b53a-4826-b8bd-4e2f5a8f0bda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:38.266614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9be1bf82-b53a-4826-b8bd-4e2f5a8f0bda tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1676 microversion: 2.1 time: 0.156305 Aug 24 16:48:38.267184 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 428/863] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:38 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:39.292274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-6d847458-7d9b-4dcd-a165-cca760992c01 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:39.293309 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-6d847458-7d9b-4dcd-a165-cca760992c01 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:39.302539 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6d847458-7d9b-4dcd-a165-cca760992c01 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:39.303036 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6d847458-7d9b-4dcd-a165-cca760992c01 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:39.303469 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6d847458-7d9b-4dcd-a165-cca760992c01 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:39.304188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6d847458-7d9b-4dcd-a165-cca760992c01 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:39.304644 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6d847458-7d9b-4dcd-a165-cca760992c01 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:39.305066 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-6d847458-7d9b-4dcd-a165-cca760992c01 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:39.442395 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-6d847458-7d9b-4dcd-a165-cca760992c01 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:39.450091 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-6d847458-7d9b-4dcd-a165-cca760992c01 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1676 microversion: 2.1 time: 0.165896 Aug 24 16:48:39.450651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 436/864] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:39 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:40.470163 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0c672f3c-00af-4a86-a13b-03862708f3dd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:40.470762 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0c672f3c-00af-4a86-a13b-03862708f3dd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:40.477318 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c672f3c-00af-4a86-a13b-03862708f3dd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.477795 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c672f3c-00af-4a86-a13b-03862708f3dd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.478227 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c672f3c-00af-4a86-a13b-03862708f3dd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.478913 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c672f3c-00af-4a86-a13b-03862708f3dd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:40.479364 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c672f3c-00af-4a86-a13b-03862708f3dd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:40.479778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c672f3c-00af-4a86-a13b-03862708f3dd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:40.608190 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-0c672f3c-00af-4a86-a13b-03862708f3dd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:40.616603 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0c672f3c-00af-4a86-a13b-03862708f3dd tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1676 microversion: 2.1 time: 0.150249 Aug 24 16:48:40.617179 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 429/865] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:40 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:41.638289 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b2b85a72-a255-4e98-9284-59e88fe9c414 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:41.638901 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b2b85a72-a255-4e98-9284-59e88fe9c414 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:41.645124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2b85a72-a255-4e98-9284-59e88fe9c414 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:41.645613 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2b85a72-a255-4e98-9284-59e88fe9c414 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:41.646053 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2b85a72-a255-4e98-9284-59e88fe9c414 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:41.646765 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2b85a72-a255-4e98-9284-59e88fe9c414 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:41.647209 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2b85a72-a255-4e98-9284-59e88fe9c414 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:41.647661 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b2b85a72-a255-4e98-9284-59e88fe9c414 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:41.779204 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b2b85a72-a255-4e98-9284-59e88fe9c414 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:41.787294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b2b85a72-a255-4e98-9284-59e88fe9c414 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1676 microversion: 2.1 time: 0.152830 Aug 24 16:48:41.787802 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 437/866] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:41 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:42.808545 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b93629f5-f5d1-4cdb-a6a6-652449f3aed5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:42.809157 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b93629f5-f5d1-4cdb-a6a6-652449f3aed5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:42.815523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b93629f5-f5d1-4cdb-a6a6-652449f3aed5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.816038 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b93629f5-f5d1-4cdb-a6a6-652449f3aed5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.816561 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b93629f5-f5d1-4cdb-a6a6-652449f3aed5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.817314 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b93629f5-f5d1-4cdb-a6a6-652449f3aed5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:42.817780 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b93629f5-f5d1-4cdb-a6a6-652449f3aed5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:42.818206 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b93629f5-f5d1-4cdb-a6a6-652449f3aed5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:42.944425 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b93629f5-f5d1-4cdb-a6a6-652449f3aed5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:42.951933 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b93629f5-f5d1-4cdb-a6a6-652449f3aed5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1676 microversion: 2.1 time: 0.147351 Aug 24 16:48:42.952511 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 430/867] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:42 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:43.974300 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-09ada19d-cb6e-48c8-9389-20d6bc7cbfdb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:43.974929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-09ada19d-cb6e-48c8-9389-20d6bc7cbfdb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:43.980955 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09ada19d-cb6e-48c8-9389-20d6bc7cbfdb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:43.981441 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09ada19d-cb6e-48c8-9389-20d6bc7cbfdb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:43.981876 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09ada19d-cb6e-48c8-9389-20d6bc7cbfdb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:43.982571 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09ada19d-cb6e-48c8-9389-20d6bc7cbfdb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:43.983029 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09ada19d-cb6e-48c8-9389-20d6bc7cbfdb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:43.983460 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-09ada19d-cb6e-48c8-9389-20d6bc7cbfdb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:44.112312 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-09ada19d-cb6e-48c8-9389-20d6bc7cbfdb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:44.120820 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-09ada19d-cb6e-48c8-9389-20d6bc7cbfdb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1676 microversion: 2.1 time: 0.150968 Aug 24 16:48:44.122967 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 438/868] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:43 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:45.142517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2cee5b2b-8f1f-44bd-aa9d-7786d1f28083 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:45.143091 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2cee5b2b-8f1f-44bd-aa9d-7786d1f28083 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:45.149950 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2cee5b2b-8f1f-44bd-aa9d-7786d1f28083 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:45.150438 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2cee5b2b-8f1f-44bd-aa9d-7786d1f28083 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:45.150866 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2cee5b2b-8f1f-44bd-aa9d-7786d1f28083 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:45.151558 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2cee5b2b-8f1f-44bd-aa9d-7786d1f28083 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:45.152041 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2cee5b2b-8f1f-44bd-aa9d-7786d1f28083 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:45.152459 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2cee5b2b-8f1f-44bd-aa9d-7786d1f28083 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:45.286802 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2cee5b2b-8f1f-44bd-aa9d-7786d1f28083 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:45.294575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2cee5b2b-8f1f-44bd-aa9d-7786d1f28083 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1676 microversion: 2.1 time: 0.156243 Aug 24 16:48:45.295143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 431/869] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:45 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:46.317131 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9566f243-5ab4-49fe-9095-204028b48f09 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:46.317778 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9566f243-5ab4-49fe-9095-204028b48f09 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:46.324207 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9566f243-5ab4-49fe-9095-204028b48f09 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.324688 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9566f243-5ab4-49fe-9095-204028b48f09 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.325122 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9566f243-5ab4-49fe-9095-204028b48f09 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.325830 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9566f243-5ab4-49fe-9095-204028b48f09 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:46.326283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9566f243-5ab4-49fe-9095-204028b48f09 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:46.326702 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9566f243-5ab4-49fe-9095-204028b48f09 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:46.455254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9566f243-5ab4-49fe-9095-204028b48f09 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:46.462989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9566f243-5ab4-49fe-9095-204028b48f09 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1676 microversion: 2.1 time: 0.150624 Aug 24 16:48:46.463551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 439/870] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:46 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:47.484176 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-075772e3-d457-467d-8b8b-34124962da00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:47.484773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-075772e3-d457-467d-8b8b-34124962da00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:47.491853 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-075772e3-d457-467d-8b8b-34124962da00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.492367 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-075772e3-d457-467d-8b8b-34124962da00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.492805 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-075772e3-d457-467d-8b8b-34124962da00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.493493 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-075772e3-d457-467d-8b8b-34124962da00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.493950 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-075772e3-d457-467d-8b8b-34124962da00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.494375 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-075772e3-d457-467d-8b8b-34124962da00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.624561 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-075772e3-d457-467d-8b8b-34124962da00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:47.632289 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-075772e3-d457-467d-8b8b-34124962da00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1653 microversion: 2.1 time: 0.151989 Aug 24 16:48:47.632850 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 432/871] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:47 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:47.652980 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d0596556-cc86-4b9f-8c2e-e108a4e862f2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:48:47.658898 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d0596556-cc86-4b9f-8c2e-e108a4e862f2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.659380 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d0596556-cc86-4b9f-8c2e-e108a4e862f2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.659811 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d0596556-cc86-4b9f-8c2e-e108a4e862f2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.682745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d0596556-cc86-4b9f-8c2e-e108a4e862f2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Going to try to start instance {{(pid=127166) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 16:48:47.722665 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d0596556-cc86-4b9f-8c2e-e108a4e862f2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.073489 Aug 24 16:48:47.723263 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 440/872] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 16:48:47 2022] POST /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:48:47.732557 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8f786420-4d0f-47d5-9493-f6cddcb58e6c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:47.733195 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8f786420-4d0f-47d5-9493-f6cddcb58e6c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:47.739688 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f786420-4d0f-47d5-9493-f6cddcb58e6c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.740661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f786420-4d0f-47d5-9493-f6cddcb58e6c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.741197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f786420-4d0f-47d5-9493-f6cddcb58e6c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.742659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f786420-4d0f-47d5-9493-f6cddcb58e6c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:47.743587 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f786420-4d0f-47d5-9493-f6cddcb58e6c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:47.744053 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8f786420-4d0f-47d5-9493-f6cddcb58e6c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:47.887618 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8f786420-4d0f-47d5-9493-f6cddcb58e6c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:47.896534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8f786420-4d0f-47d5-9493-f6cddcb58e6c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1662 microversion: 2.1 time: 0.168318 Aug 24 16:48:47.896944 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 433/873] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:47 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:48.919176 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dc608af0-dad0-4fbf-ad54-3b3d70d4dbe5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:48.919911 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-dc608af0-dad0-4fbf-ad54-3b3d70d4dbe5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:48.926023 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dc608af0-dad0-4fbf-ad54-3b3d70d4dbe5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:48.926512 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dc608af0-dad0-4fbf-ad54-3b3d70d4dbe5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:48.926994 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dc608af0-dad0-4fbf-ad54-3b3d70d4dbe5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:48.927687 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dc608af0-dad0-4fbf-ad54-3b3d70d4dbe5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:48.928185 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dc608af0-dad0-4fbf-ad54-3b3d70d4dbe5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:48.928612 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dc608af0-dad0-4fbf-ad54-3b3d70d4dbe5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:49.063912 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-dc608af0-dad0-4fbf-ad54-3b3d70d4dbe5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:49.072157 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-dc608af0-dad0-4fbf-ad54-3b3d70d4dbe5 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1662 microversion: 2.1 time: 0.157201 Aug 24 16:48:49.072720 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 441/874] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:48 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:48:50.093636 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-89a6cfa3-0736-48af-83ae-a4e2ca1bf907 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:48:50.094239 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-89a6cfa3-0736-48af-83ae-a4e2ca1bf907 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:48:50.101000 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-89a6cfa3-0736-48af-83ae-a4e2ca1bf907 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:50.101484 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-89a6cfa3-0736-48af-83ae-a4e2ca1bf907 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:50.101913 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-89a6cfa3-0736-48af-83ae-a4e2ca1bf907 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:50.102607 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-89a6cfa3-0736-48af-83ae-a4e2ca1bf907 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:48:50.103055 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-89a6cfa3-0736-48af-83ae-a4e2ca1bf907 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:48:50.103536 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-89a6cfa3-0736-48af-83ae-a4e2ca1bf907 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:48:50.234839 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-89a6cfa3-0736-48af-83ae-a4e2ca1bf907 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:48:50.243064 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-89a6cfa3-0736-48af-83ae-a4e2ca1bf907 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1666 microversion: 2.1 time: 0.153022 Aug 24 16:48:50.243812 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 434/875] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:48:50 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:22.616609 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b35c1de3-3ee6-4ec3-876b-201e7d6b51be tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:22.618875 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b35c1de3-3ee6-4ec3-876b-201e7d6b51be tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:22.621073 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=16 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:22.621758 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:22.627641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b35c1de3-3ee6-4ec3-876b-201e7d6b51be tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.628171 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b35c1de3-3ee6-4ec3-876b-201e7d6b51be tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.628607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b35c1de3-3ee6-4ec3-876b-201e7d6b51be tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.629333 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b35c1de3-3ee6-4ec3-876b-201e7d6b51be tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.629881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b35c1de3-3ee6-4ec3-876b-201e7d6b51be tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.630310 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b35c1de3-3ee6-4ec3-876b-201e7d6b51be tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.661453 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b35c1de3-3ee6-4ec3-876b-201e7d6b51be tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048175 Aug 24 16:49:22.662027 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 442/876] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:49:22 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:49:22.723065 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c334d4bb-59ed-49ee-ad75-1ac0e51bd510 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:22.723643 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c334d4bb-59ed-49ee-ad75-1ac0e51bd510 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:22.725966 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=16 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:22.726634 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:22.732623 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c334d4bb-59ed-49ee-ad75-1ac0e51bd510 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.733128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c334d4bb-59ed-49ee-ad75-1ac0e51bd510 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.733583 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c334d4bb-59ed-49ee-ad75-1ac0e51bd510 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.734267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c334d4bb-59ed-49ee-ad75-1ac0e51bd510 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.734714 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c334d4bb-59ed-49ee-ad75-1ac0e51bd510 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.735128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c334d4bb-59ed-49ee-ad75-1ac0e51bd510 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.760862 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c334d4bb-59ed-49ee-ad75-1ac0e51bd510 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:22.834637 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c334d4bb-59ed-49ee-ad75-1ac0e51bd510 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 204 len: 0 microversion: 2.1 time: 0.115129 Aug 24 16:49:22.835145 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 435/877] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:22 2022] DELETE /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:22.844638 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-10cf197a-98a5-47bb-9a30-08006e00e3d0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:22.845244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-10cf197a-98a5-47bb-9a30-08006e00e3d0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:22.851690 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-10cf197a-98a5-47bb-9a30-08006e00e3d0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.852212 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-10cf197a-98a5-47bb-9a30-08006e00e3d0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.852652 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-10cf197a-98a5-47bb-9a30-08006e00e3d0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.853352 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-10cf197a-98a5-47bb-9a30-08006e00e3d0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:22.853813 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-10cf197a-98a5-47bb-9a30-08006e00e3d0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:22.854242 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-10cf197a-98a5-47bb-9a30-08006e00e3d0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:22.984347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-10cf197a-98a5-47bb-9a30-08006e00e3d0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:22.992401 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-10cf197a-98a5-47bb-9a30-08006e00e3d0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1672 microversion: 2.1 time: 0.152478 Aug 24 16:49:22.992967 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 443/878] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:22 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:24.015082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9abdb8c2-8c51-4d1a-bb1a-5aa1089610f8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:24.015690 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9abdb8c2-8c51-4d1a-bb1a-5aa1089610f8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:24.023475 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9abdb8c2-8c51-4d1a-bb1a-5aa1089610f8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.023992 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9abdb8c2-8c51-4d1a-bb1a-5aa1089610f8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.024427 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9abdb8c2-8c51-4d1a-bb1a-5aa1089610f8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.025122 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9abdb8c2-8c51-4d1a-bb1a-5aa1089610f8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:24.025586 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9abdb8c2-8c51-4d1a-bb1a-5aa1089610f8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:24.025998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-9abdb8c2-8c51-4d1a-bb1a-5aa1089610f8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:24.353870 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9abdb8c2-8c51-4d1a-bb1a-5aa1089610f8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:24.361690 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9abdb8c2-8c51-4d1a-bb1a-5aa1089610f8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1672 microversion: 2.1 time: 0.351189 Aug 24 16:49:24.362259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 436/879] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:24 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1672 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:25.382300 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-431cad3e-86c9-4f59-a679-034050612285 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:25.382943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-431cad3e-86c9-4f59-a679-034050612285 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:25.389320 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-431cad3e-86c9-4f59-a679-034050612285 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.389808 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-431cad3e-86c9-4f59-a679-034050612285 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.390392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-431cad3e-86c9-4f59-a679-034050612285 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.391093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-431cad3e-86c9-4f59-a679-034050612285 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:25.391545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-431cad3e-86c9-4f59-a679-034050612285 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:25.392082 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-431cad3e-86c9-4f59-a679-034050612285 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:25.528209 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-431cad3e-86c9-4f59-a679-034050612285 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:25.536898 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-431cad3e-86c9-4f59-a679-034050612285 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 200 len: 1672 microversion: 2.1 time: 0.158469 Aug 24 16:49:25.537491 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 444/880] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:25 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:26.005248 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-8376c833-d3d3-49d0-b80d-80b312bb8e68 req-0aae017c-98f1-4d33-b655-90c5ea9dade1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c945bfc4-12ec-45eb-83b6-9e1c55d54e0e", "name": "network-vif-deleted", "tag": "25979989-4af1-45cb-a77e-fb7d3359fce0"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:26.015069 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-8376c833-d3d3-49d0-b80d-80b312bb8e68 req-0aae017c-98f1-4d33-b655-90c5ea9dade1 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.015555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-8376c833-d3d3-49d0-b80d-80b312bb8e68 req-0aae017c-98f1-4d33-b655-90c5ea9dade1 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.016632 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-8376c833-d3d3-49d0-b80d-80b312bb8e68 req-0aae017c-98f1-4d33-b655-90c5ea9dade1 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.028426 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-8376c833-d3d3-49d0-b80d-80b312bb8e68 req-0aae017c-98f1-4d33-b655-90c5ea9dade1 service nova] Creating event network-vif-deleted:25979989-4af1-45cb-a77e-fb7d3359fce0 for instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e on hv-cinder-77957 Aug 24 16:49:26.034663 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-8376c833-d3d3-49d0-b80d-80b312bb8e68 req-0aae017c-98f1-4d33-b655-90c5ea9dade1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033167 Aug 24 16:49:26.035274 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 437/881] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:26.559338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:26.559992 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:26.566124 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.566603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.567582 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.568307 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:26.568771 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:26.569199 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:26.583274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] HTTP exception thrown: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Request method failure captured: Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e HTTP/1.1 Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlX1XB-moZkqHKxHm26Cv6FmrV_toO80CieMwI0dv18X7ISxMo0XMSMVzCF1EWK0fah7Q3PPXv88YTR0dD__J2DC2lvm8Je_unKGq1VfNdViGTqA1SAWr3V0oIEQ-iHosOVO0ZFxSrE0w4mwh-zDL4VJRZoFrFfU3Zx2QPxog0oqMNM Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:49:26.584946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd03bbf32154ccabb8d233f00347081", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 481ae20977e8424cb460d8108905577d Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:49:26.586411 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'c945bfc4-12ec-45eb-83b6-9e1c55d54e0e'} Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:49:26.587322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:49:26.588699 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:49:26.589862 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Returning 404 to user: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:49:26.589862 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c939a438-8ffd-43fa-b087-e20c24694b7c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 404 len: 111 microversion: 2.1 time: 0.031800 Aug 24 16:49:26.589862 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 445/882] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:26 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:26.595842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-788bd03a-4f9a-40a3-acc1-72aaa143409a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '.version_select at 0x7f063ab321f0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:26.616242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-788bd03a-4f9a-40a3-acc1-72aaa143409a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-731977943" status: 202 len: 0 microversion: 2.1 time: 0.024372 Aug 24 16:49:26.616912 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 438/883] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Aug 24 16:49:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-731977943 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:49:27.280552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1725aebb-c642-4b7a-9a9f-e35ce31626c3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'create', calling method: .version_select at 0x7f063abf2940>, body: {"keypair": {"name": "tempest-keypair-459081915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfEbB4IpsM6jVMGTeggx8pIkmOUIc45g9pUU3B+ILGqtfb7nIiMUkSW1GPcshgZmfeNGWMAt6olZuKwYR0CqjWRtFn6TQqLTFze/3ck2jKkzFoiUF//T/XBuD3F6X6wXA=="}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:27.297506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-1725aebb-c642-4b7a-9a9f-e35ce31626c3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Getting quotas for project ebd03bbf32154ccabb8d233f00347081. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:49:27.301748 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-1725aebb-c642-4b7a-9a9f-e35ce31626c3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Getting quotas for user 481ae20977e8424cb460d8108905577d and project ebd03bbf32154ccabb8d233f00347081. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:49:27.330406 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1725aebb-c642-4b7a-9a9f-e35ce31626c3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053702 Aug 24 16:49:27.331367 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 446/884] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 16:49:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:28.604306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-856339690", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3cab1eb-c87b-420a-a1f1-ac1c4fc49db1"}], "security_groups": [{"name": "tempest-securitygroup--809130922"}], "key_name": "tempest-keypair-459081915", "user_data": "}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:28.709453 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] validate_networks() for [('e3cab1eb-c87b-420a-a1f1-ac1c4fc49db1', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:49:29.138356 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:49:29.139040 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:49:29.139682 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:49:29.140244 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:49:29.140659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:49:29.150276 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:29.151354 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:29.151817 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:29.152576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:29.153035 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:29.153448 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:29.171554 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Getting quotas for project ebd03bbf32154ccabb8d233f00347081. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:49:29.175372 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Getting quotas for user 481ae20977e8424cb460d8108905577d and project ebd03bbf32154ccabb8d233f00347081. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:49:29.186278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:49:29.188686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:49:29.235342 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b2f8b9e1-05f7-4fd5-afda-23f41d9d7f2e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.636508 Aug 24 16:49:29.242017 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 439/885] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:49:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:49:29.247087 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-27bf6283-5eb3-410b-923e-58b761c2891a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:29.247703 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-27bf6283-5eb3-410b-923e-58b761c2891a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:29.366587 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-27bf6283-5eb3-410b-923e-58b761c2891a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:29.378186 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-27bf6283-5eb3-410b-923e-58b761c2891a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1236 microversion: 2.1 time: 0.134171 Aug 24 16:49:29.379773 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 447/886] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:29 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1236 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:30.399219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-71b95e45-ad34-47b1-9608-c6ab779f761e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:30.399833 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-71b95e45-ad34-47b1-9608-c6ab779f761e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:30.406096 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-71b95e45-ad34-47b1-9608-c6ab779f761e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:30.406582 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-71b95e45-ad34-47b1-9608-c6ab779f761e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:30.407019 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-71b95e45-ad34-47b1-9608-c6ab779f761e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:30.407711 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-71b95e45-ad34-47b1-9608-c6ab779f761e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:30.408212 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-71b95e45-ad34-47b1-9608-c6ab779f761e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:30.408639 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-71b95e45-ad34-47b1-9608-c6ab779f761e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:30.476464 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-71b95e45-ad34-47b1-9608-c6ab779f761e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:30.486803 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-71b95e45-ad34-47b1-9608-c6ab779f761e tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1296 microversion: 2.1 time: 0.092021 Aug 24 16:49:30.488951 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 440/887] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:30 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:31.509836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c34f81f2-d40b-430a-a5d5-b889b947f7bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:31.511060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c34f81f2-d40b-430a-a5d5-b889b947f7bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:31.517349 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c34f81f2-d40b-430a-a5d5-b889b947f7bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:31.517847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c34f81f2-d40b-430a-a5d5-b889b947f7bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:31.518438 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c34f81f2-d40b-430a-a5d5-b889b947f7bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:31.519167 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c34f81f2-d40b-430a-a5d5-b889b947f7bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:31.519628 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c34f81f2-d40b-430a-a5d5-b889b947f7bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:31.520085 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c34f81f2-d40b-430a-a5d5-b889b947f7bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:31.658741 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c34f81f2-d40b-430a-a5d5-b889b947f7bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:31.667641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c34f81f2-d40b-430a-a5d5-b889b947f7bb tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1361 microversion: 2.1 time: 0.162400 Aug 24 16:49:31.668870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 448/888] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:31 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:32.054686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-ace11271-558c-47c5-879d-168ffb5ce5e0 req-ee8e03ed-0059-41b5-8b81-80821c6e2c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63", "tag": "adfa3691-d4e0-43f8-8b83-df9b96c5701c"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:32.066584 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-ace11271-558c-47c5-879d-168ffb5ce5e0 req-ee8e03ed-0059-41b5-8b81-80821c6e2c03 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.067064 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-ace11271-558c-47c5-879d-168ffb5ce5e0 req-ee8e03ed-0059-41b5-8b81-80821c6e2c03 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.067656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-ace11271-558c-47c5-879d-168ffb5ce5e0 req-ee8e03ed-0059-41b5-8b81-80821c6e2c03 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.079292 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-ace11271-558c-47c5-879d-168ffb5ce5e0 req-ee8e03ed-0059-41b5-8b81-80821c6e2c03 service nova] Creating event network-changed:adfa3691-d4e0-43f8-8b83-df9b96c5701c for instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 on hv-cinder-77957 Aug 24 16:49:32.085285 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-ace11271-558c-47c5-879d-168ffb5ce5e0 req-ee8e03ed-0059-41b5-8b81-80821c6e2c03 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034817 Aug 24 16:49:32.085883 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 441/889] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:32.690748 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-54d97499-8c41-4f0e-b2f2-042eb7d71905 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:32.691369 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-54d97499-8c41-4f0e-b2f2-042eb7d71905 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:32.697635 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-54d97499-8c41-4f0e-b2f2-042eb7d71905 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.698121 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-54d97499-8c41-4f0e-b2f2-042eb7d71905 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.698665 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-54d97499-8c41-4f0e-b2f2-042eb7d71905 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.699392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-54d97499-8c41-4f0e-b2f2-042eb7d71905 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:32.699990 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-54d97499-8c41-4f0e-b2f2-042eb7d71905 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:32.700291 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-54d97499-8c41-4f0e-b2f2-042eb7d71905 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:32.829541 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-54d97499-8c41-4f0e-b2f2-042eb7d71905 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:32.838352 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-54d97499-8c41-4f0e-b2f2-042eb7d71905 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1361 microversion: 2.1 time: 0.151536 Aug 24 16:49:32.838919 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 449/890] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:32 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:33.859710 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c82f58c1-b977-4eb5-bdb5-ec3d3f886f98 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:33.860436 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c82f58c1-b977-4eb5-bdb5-ec3d3f886f98 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:33.867156 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82f58c1-b977-4eb5-bdb5-ec3d3f886f98 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.867663 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82f58c1-b977-4eb5-bdb5-ec3d3f886f98 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.868112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82f58c1-b977-4eb5-bdb5-ec3d3f886f98 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:33.868812 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82f58c1-b977-4eb5-bdb5-ec3d3f886f98 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:33.869273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82f58c1-b977-4eb5-bdb5-ec3d3f886f98 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:33.869711 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82f58c1-b977-4eb5-bdb5-ec3d3f886f98 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:34.003560 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c82f58c1-b977-4eb5-bdb5-ec3d3f886f98 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:34.011891 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c82f58c1-b977-4eb5-bdb5-ec3d3f886f98 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1361 microversion: 2.1 time: 0.156471 Aug 24 16:49:34.012478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 442/891] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:33 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:35.033212 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-9620e381-633c-4328-9f8c-19a5137c594c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:35.033838 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-9620e381-633c-4328-9f8c-19a5137c594c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:35.040595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9620e381-633c-4328-9f8c-19a5137c594c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.041110 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9620e381-633c-4328-9f8c-19a5137c594c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.041547 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9620e381-633c-4328-9f8c-19a5137c594c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.042241 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9620e381-633c-4328-9f8c-19a5137c594c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:35.042702 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9620e381-633c-4328-9f8c-19a5137c594c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:35.043123 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-9620e381-633c-4328-9f8c-19a5137c594c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:35.172269 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-9620e381-633c-4328-9f8c-19a5137c594c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:35.180100 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-9620e381-633c-4328-9f8c-19a5137c594c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1361 microversion: 2.1 time: 0.150810 Aug 24 16:49:35.180663 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 450/892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:35 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:36.201260 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c42acee7-a210-4574-8ff6-df400986180b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:36.201906 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c42acee7-a210-4574-8ff6-df400986180b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:36.208247 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c42acee7-a210-4574-8ff6-df400986180b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.208719 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c42acee7-a210-4574-8ff6-df400986180b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.209143 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c42acee7-a210-4574-8ff6-df400986180b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.209818 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c42acee7-a210-4574-8ff6-df400986180b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:36.210264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c42acee7-a210-4574-8ff6-df400986180b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:36.210680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c42acee7-a210-4574-8ff6-df400986180b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:36.335410 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c42acee7-a210-4574-8ff6-df400986180b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:36.342879 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c42acee7-a210-4574-8ff6-df400986180b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1361 microversion: 2.1 time: 0.145494 Aug 24 16:49:36.343443 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 443/893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:36 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:37.363488 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5f3ffe72-50ea-4236-bc29-a8392b468ad7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:37.364142 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5f3ffe72-50ea-4236-bc29-a8392b468ad7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:37.370077 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f3ffe72-50ea-4236-bc29-a8392b468ad7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.370554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f3ffe72-50ea-4236-bc29-a8392b468ad7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.370983 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f3ffe72-50ea-4236-bc29-a8392b468ad7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.371664 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f3ffe72-50ea-4236-bc29-a8392b468ad7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.372140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f3ffe72-50ea-4236-bc29-a8392b468ad7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.372561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f3ffe72-50ea-4236-bc29-a8392b468ad7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.503212 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5f3ffe72-50ea-4236-bc29-a8392b468ad7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:37.511422 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5f3ffe72-50ea-4236-bc29-a8392b468ad7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1361 microversion: 2.1 time: 0.151749 Aug 24 16:49:37.512017 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 451/894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:37 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:37.733916 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-9b38668f-0dcd-46d9-b992-63d321c77f0d req-c4d18b14-53de-41fc-b554-5dfda1e01c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63", "name": "network-vif-plugged", "status": "completed", "tag": "adfa3691-d4e0-43f8-8b83-df9b96c5701c"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:37.744866 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-9b38668f-0dcd-46d9-b992-63d321c77f0d req-c4d18b14-53de-41fc-b554-5dfda1e01c06 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:37.745348 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-9b38668f-0dcd-46d9-b992-63d321c77f0d req-c4d18b14-53de-41fc-b554-5dfda1e01c06 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:37.745782 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-9b38668f-0dcd-46d9-b992-63d321c77f0d req-c4d18b14-53de-41fc-b554-5dfda1e01c06 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:37.757375 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-9b38668f-0dcd-46d9-b992-63d321c77f0d req-c4d18b14-53de-41fc-b554-5dfda1e01c06 service nova] Creating event network-vif-plugged:adfa3691-d4e0-43f8-8b83-df9b96c5701c for instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 on hv-cinder-77957 Aug 24 16:49:37.762408 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-9b38668f-0dcd-46d9-b992-63d321c77f0d req-c4d18b14-53de-41fc-b554-5dfda1e01c06 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032225 Aug 24 16:49:37.763100 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 444/895] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:38.534591 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7e22e9c1-d6b4-4950-bea9-8871850154a2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:38.535289 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-7e22e9c1-d6b4-4950-bea9-8871850154a2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:38.542506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e22e9c1-d6b4-4950-bea9-8871850154a2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.543118 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e22e9c1-d6b4-4950-bea9-8871850154a2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.543899 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e22e9c1-d6b4-4950-bea9-8871850154a2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.544831 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e22e9c1-d6b4-4950-bea9-8871850154a2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:38.545662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e22e9c1-d6b4-4950-bea9-8871850154a2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:38.546164 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-7e22e9c1-d6b4-4950-bea9-8871850154a2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:38.693941 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-7e22e9c1-d6b4-4950-bea9-8871850154a2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:38.701835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7e22e9c1-d6b4-4950-bea9-8871850154a2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1361 microversion: 2.1 time: 0.172612 Aug 24 16:49:38.702414 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 452/896] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:38 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:39.727075 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:39.727836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=6 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:39.731987 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-02c9667d-1916-4444-8d89-451d9ca9104b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:39.732687 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-02c9667d-1916-4444-8d89-451d9ca9104b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:39.739893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-02c9667d-1916-4444-8d89-451d9ca9104b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.740405 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-02c9667d-1916-4444-8d89-451d9ca9104b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.740842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-02c9667d-1916-4444-8d89-451d9ca9104b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.741535 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-02c9667d-1916-4444-8d89-451d9ca9104b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.741991 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-02c9667d-1916-4444-8d89-451d9ca9104b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.742413 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-02c9667d-1916-4444-8d89-451d9ca9104b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.874013 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-02c9667d-1916-4444-8d89-451d9ca9104b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:39.882256 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-02c9667d-1916-4444-8d89-451d9ca9104b tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1546 microversion: 2.1 time: 0.156546 Aug 24 16:49:39.882820 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 445/897] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:39 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:39.903053 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-24ff9451-7dad-49ae-b6a1-6ba1224abe00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:39.903554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-24ff9451-7dad-49ae-b6a1-6ba1224abe00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:39.905381 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=6 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:39.910684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-24ff9451-7dad-49ae-b6a1-6ba1224abe00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.911173 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-24ff9451-7dad-49ae-b6a1-6ba1224abe00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.911772 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-24ff9451-7dad-49ae-b6a1-6ba1224abe00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.912346 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-24ff9451-7dad-49ae-b6a1-6ba1224abe00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:39.912804 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-24ff9451-7dad-49ae-b6a1-6ba1224abe00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:39.913229 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-24ff9451-7dad-49ae-b6a1-6ba1224abe00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:39.988250 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-24ff9451-7dad-49ae-b6a1-6ba1224abe00 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088902 Aug 24 16:49:39.988859 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 453/898] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 16:49:39 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:41.127393 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-d3568e86-9b77-427f-a493-908668bcbb0e req-04efaf2b-7999-4227-abd7-6506d00b231d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63", "tag": "adfa3691-d4e0-43f8-8b83-df9b96c5701c"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:41.137273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-d3568e86-9b77-427f-a493-908668bcbb0e req-04efaf2b-7999-4227-abd7-6506d00b231d service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:41.137844 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-d3568e86-9b77-427f-a493-908668bcbb0e req-04efaf2b-7999-4227-abd7-6506d00b231d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:41.138345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-d3568e86-9b77-427f-a493-908668bcbb0e req-04efaf2b-7999-4227-abd7-6506d00b231d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:41.149538 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-d3568e86-9b77-427f-a493-908668bcbb0e req-04efaf2b-7999-4227-abd7-6506d00b231d service nova] Creating event network-changed:adfa3691-d4e0-43f8-8b83-df9b96c5701c for instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 on hv-cinder-77957 Aug 24 16:49:41.154225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-d3568e86-9b77-427f-a493-908668bcbb0e req-04efaf2b-7999-4227-abd7-6506d00b231d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030546 Aug 24 16:49:41.154810 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 446/899] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:56.397088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.398658 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=54 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.400128 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.401701 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.402965 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-bf448a60-36ab-4a51-b9c8-b5f8e4f20072 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:56.403611 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-bf448a60-36ab-4a51-b9c8-b5f8e4f20072 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:56.406241 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-258e92b6-2760-4ab7-848c-fc0388bc195f req-37fc2904-da61-4b97-b320-dd5d63887e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402e30ca-e4f0-41a7-be41-890f9356d7de", "tag": "793907c0-b739-4a8a-9006-bb1625d3baa2"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:56.411788 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bf448a60-36ab-4a51-b9c8-b5f8e4f20072 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.412313 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bf448a60-36ab-4a51-b9c8-b5f8e4f20072 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.412749 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bf448a60-36ab-4a51-b9c8-b5f8e4f20072 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.413759 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bf448a60-36ab-4a51-b9c8-b5f8e4f20072 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.414145 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bf448a60-36ab-4a51-b9c8-b5f8e4f20072 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.414603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bf448a60-36ab-4a51-b9c8-b5f8e4f20072 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.418874 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-258e92b6-2760-4ab7-848c-fc0388bc195f req-37fc2904-da61-4b97-b320-dd5d63887e75 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.419426 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-258e92b6-2760-4ab7-848c-fc0388bc195f req-37fc2904-da61-4b97-b320-dd5d63887e75 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.419858 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-258e92b6-2760-4ab7-848c-fc0388bc195f req-37fc2904-da61-4b97-b320-dd5d63887e75 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.435237 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-258e92b6-2760-4ab7-848c-fc0388bc195f req-37fc2904-da61-4b97-b320-dd5d63887e75 service nova] Creating event network-changed:793907c0-b739-4a8a-9006-bb1625d3baa2 for instance 402e30ca-e4f0-41a7-be41-890f9356d7de on hv-cinder-77957 Aug 24 16:49:56.441027 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-258e92b6-2760-4ab7-848c-fc0388bc195f req-37fc2904-da61-4b97-b320-dd5d63887e75 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042495 Aug 24 16:49:56.441804 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 447/900] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:56.443990 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-bf448a60-36ab-4a51-b9c8-b5f8e4f20072 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Going to try to terminate instance {{(pid=127166) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:49:56.541701 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-bf448a60-36ab-4a51-b9c8-b5f8e4f20072 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "DELETE /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 204 len: 0 microversion: 2.1 time: 0.145264 Aug 24 16:49:56.542983 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 454/901] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:49:56 2022] DELETE /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:56.552189 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6fc78dac-dce9-47b6-b8c6-8cb398028ea6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:56.552885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6fc78dac-dce9-47b6-b8c6-8cb398028ea6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:56.561365 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fc78dac-dce9-47b6-b8c6-8cb398028ea6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.561853 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fc78dac-dce9-47b6-b8c6-8cb398028ea6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.562278 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fc78dac-dce9-47b6-b8c6-8cb398028ea6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.563000 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fc78dac-dce9-47b6-b8c6-8cb398028ea6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:56.563449 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fc78dac-dce9-47b6-b8c6-8cb398028ea6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:56.563867 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fc78dac-dce9-47b6-b8c6-8cb398028ea6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:56.707758 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6fc78dac-dce9-47b6-b8c6-8cb398028ea6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:56.715680 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6fc78dac-dce9-47b6-b8c6-8cb398028ea6 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1577 microversion: 2.1 time: 0.168228 Aug 24 16:49:56.716289 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 448/902] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:56 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:57.739222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-8d257271-d728-4fa9-baa2-7e37dd41fec0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:57.740059 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-8d257271-d728-4fa9-baa2-7e37dd41fec0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:57.746057 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d257271-d728-4fa9-baa2-7e37dd41fec0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:57.746542 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d257271-d728-4fa9-baa2-7e37dd41fec0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:57.746977 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d257271-d728-4fa9-baa2-7e37dd41fec0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.747678 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d257271-d728-4fa9-baa2-7e37dd41fec0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:57.748196 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d257271-d728-4fa9-baa2-7e37dd41fec0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:57.748625 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-8d257271-d728-4fa9-baa2-7e37dd41fec0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:57.888463 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-8d257271-d728-4fa9-baa2-7e37dd41fec0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:57.896162 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-8d257271-d728-4fa9-baa2-7e37dd41fec0 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1577 microversion: 2.1 time: 0.161786 Aug 24 16:49:57.896731 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 455/903] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:57 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:58.752768 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-16e6e714-2a8d-4f1a-8bfe-69b64c9ef886 req-3c0dd44b-aa85-4169-aca3-6808f6f854f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "402e30ca-e4f0-41a7-be41-890f9356d7de", "name": "network-vif-deleted", "tag": "793907c0-b739-4a8a-9006-bb1625d3baa2"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:49:58.763818 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-16e6e714-2a8d-4f1a-8bfe-69b64c9ef886 req-3c0dd44b-aa85-4169-aca3-6808f6f854f4 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.764346 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-16e6e714-2a8d-4f1a-8bfe-69b64c9ef886 req-3c0dd44b-aa85-4169-aca3-6808f6f854f4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.764773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-16e6e714-2a8d-4f1a-8bfe-69b64c9ef886 req-3c0dd44b-aa85-4169-aca3-6808f6f854f4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.776939 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-16e6e714-2a8d-4f1a-8bfe-69b64c9ef886 req-3c0dd44b-aa85-4169-aca3-6808f6f854f4 service nova] Creating event network-vif-deleted:793907c0-b739-4a8a-9006-bb1625d3baa2 for instance 402e30ca-e4f0-41a7-be41-890f9356d7de on hv-cinder-77957 Aug 24 16:49:58.781661 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-16e6e714-2a8d-4f1a-8bfe-69b64c9ef886 req-3c0dd44b-aa85-4169-aca3-6808f6f854f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032553 Aug 24 16:49:58.782245 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 449/904] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:49:58.917732 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2de16211-ae72-4ea5-8471-da94016b4576 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:49:58.918255 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2de16211-ae72-4ea5-8471-da94016b4576 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:49:58.924129 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2de16211-ae72-4ea5-8471-da94016b4576 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.924611 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2de16211-ae72-4ea5-8471-da94016b4576 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.925046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2de16211-ae72-4ea5-8471-da94016b4576 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.925733 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2de16211-ae72-4ea5-8471-da94016b4576 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:49:58.926577 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2de16211-ae72-4ea5-8471-da94016b4576 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:49:58.927023 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2de16211-ae72-4ea5-8471-da94016b4576 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:49:58.990949 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2de16211-ae72-4ea5-8471-da94016b4576 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:49:58.998704 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2de16211-ae72-4ea5-8471-da94016b4576 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 200 len: 1226 microversion: 2.1 time: 0.084869 Aug 24 16:49:58.999271 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 456/905] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:49:58 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:00.020264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:00.021587 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 402e30ca-e4f0-41a7-be41-890f9356d7de] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:00.027614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:00.028135 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:00.028567 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:00.029248 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:00.029701 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:00.030120 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:00.043590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] HTTP exception thrown: Instance 402e30ca-e4f0-41a7-be41-890f9356d7de could not be found. Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Request method failure captured: Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de HTTP/1.1 Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlTz42ucFQOgcikyVSr4o5VXyZ_N2xwj4hT0vEl60zJ-iZcygcpxmXVbsYVLxSmRjbOWNvNyA3JrS70vIa5M74t7BkFCm_8eXVPYK3j6rlYy2PM2c319d1o7voVuJJWTwZw_SkEJ6FC-VhrIoosXEVvwY7hEuR278wcVBQrN8S3S514 Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 7c99de6ca9094fa7bd119a3be6817725 Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:50:00.045242 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7c99de6ca9094fa7bd119a3be6817725", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 7c99de6ca9094fa7bd119a3be6817725 Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-TestVolumeBootPattern-1282274193-project Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: bb5d3834f04142e288c04cc05665329f Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-TestVolumeBootPattern-1282274193-project Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 402e30ca-e4f0-41a7-be41-890f9356d7de could not be found. Aug 24 16:50:00.046998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '402e30ca-e4f0-41a7-be41-890f9356d7de'} Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 402e30ca-e4f0-41a7-be41-890f9356d7de could not be found. Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:00.047938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 402e30ca-e4f0-41a7-be41-890f9356d7de could not be found. Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 402e30ca-e4f0-41a7-be41-890f9356d7de could not be found. Aug 24 16:50:00.049362 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:00.050576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Returning 404 to user: Instance 402e30ca-e4f0-41a7-be41-890f9356d7de could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:00.050576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c506f87f-4688-4053-8661-d24536f60844 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de" status: 404 len: 111 microversion: 2.1 time: 0.031042 Aug 24 16:50:00.050576 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 450/906] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:00 2022] GET /compute/v2.1/servers/402e30ca-e4f0-41a7-be41-890f9356d7de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:03.101013 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f5d19d42-8b81-4b47-94e8-2e63f41b8a3a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:03.101743 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f5d19d42-8b81-4b47-94e8-2e63f41b8a3a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:03.102942 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-9ef8fc58-67e9-4ed5-9f35-4c8db8d060c4 req-a31662d5-4607-4892-8662-c3ac90c66ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c16b9f1-a570-4574-9f31-55ee4d2c0345", "tag": "08e2ad33-cf8e-48c5-af02-bfc6e0668156"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:03.108056 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5d19d42-8b81-4b47-94e8-2e63f41b8a3a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.108624 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5d19d42-8b81-4b47-94e8-2e63f41b8a3a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.109140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5d19d42-8b81-4b47-94e8-2e63f41b8a3a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.109853 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5d19d42-8b81-4b47-94e8-2e63f41b8a3a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.110312 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5d19d42-8b81-4b47-94e8-2e63f41b8a3a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.110737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f5d19d42-8b81-4b47-94e8-2e63f41b8a3a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.112813 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-9ef8fc58-67e9-4ed5-9f35-4c8db8d060c4 req-a31662d5-4607-4892-8662-c3ac90c66ac7 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.113298 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-9ef8fc58-67e9-4ed5-9f35-4c8db8d060c4 req-a31662d5-4607-4892-8662-c3ac90c66ac7 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.113732 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-9ef8fc58-67e9-4ed5-9f35-4c8db8d060c4 req-a31662d5-4607-4892-8662-c3ac90c66ac7 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.125118 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-9ef8fc58-67e9-4ed5-9f35-4c8db8d060c4 req-a31662d5-4607-4892-8662-c3ac90c66ac7 service nova] Creating event network-changed:08e2ad33-cf8e-48c5-af02-bfc6e0668156 for instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 on hv-cinder-77957 Aug 24 16:50:03.130714 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-9ef8fc58-67e9-4ed5-9f35-4c8db8d060c4 req-a31662d5-4607-4892-8662-c3ac90c66ac7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031508 Aug 24 16:50:03.131755 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 451/907] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:50:03.139056 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f5d19d42-8b81-4b47-94e8-2e63f41b8a3a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Going to try to terminate instance {{(pid=127166) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:50:03.226352 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f5d19d42-8b81-4b47-94e8-2e63f41b8a3a tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 204 len: 0 microversion: 2.1 time: 0.129799 Aug 24 16:50:03.227403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 457/908] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:50:03 2022] DELETE /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:03.237096 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-661430ad-6328-43d7-85d1-00c142ee468e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:03.238875 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-661430ad-6328-43d7-85d1-00c142ee468e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:03.246167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-661430ad-6328-43d7-85d1-00c142ee468e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.246664 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-661430ad-6328-43d7-85d1-00c142ee468e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.247102 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-661430ad-6328-43d7-85d1-00c142ee468e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.247812 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-661430ad-6328-43d7-85d1-00c142ee468e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:03.248480 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-661430ad-6328-43d7-85d1-00c142ee468e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:03.248913 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-661430ad-6328-43d7-85d1-00c142ee468e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:03.408604 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-661430ad-6328-43d7-85d1-00c142ee468e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:03.417908 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-661430ad-6328-43d7-85d1-00c142ee468e tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1578 microversion: 2.1 time: 0.185216 Aug 24 16:50:03.418523 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 452/909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:03 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:04.439261 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-00175cff-4a95-4c35-a4d3-c89a9465af97 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:04.440098 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-00175cff-4a95-4c35-a4d3-c89a9465af97 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:04.446740 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-00175cff-4a95-4c35-a4d3-c89a9465af97 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:04.447218 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-00175cff-4a95-4c35-a4d3-c89a9465af97 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:04.447646 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-00175cff-4a95-4c35-a4d3-c89a9465af97 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:04.448364 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-00175cff-4a95-4c35-a4d3-c89a9465af97 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:04.448819 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-00175cff-4a95-4c35-a4d3-c89a9465af97 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:04.449237 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-00175cff-4a95-4c35-a4d3-c89a9465af97 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:04.652554 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-00175cff-4a95-4c35-a4d3-c89a9465af97 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:04.660276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-00175cff-4a95-4c35-a4d3-c89a9465af97 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1578 microversion: 2.1 time: 0.225195 Aug 24 16:50:04.660867 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 458/910] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:04 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:05.381811 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-5fbdae3f-cf94-414a-9e02-57a60b08ccc2 req-733699a4-9fbf-4f40-ac46-aadb180d142f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c16b9f1-a570-4574-9f31-55ee4d2c0345", "name": "network-vif-deleted", "tag": "08e2ad33-cf8e-48c5-af02-bfc6e0668156"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:05.391241 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5fbdae3f-cf94-414a-9e02-57a60b08ccc2 req-733699a4-9fbf-4f40-ac46-aadb180d142f service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:05.391716 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5fbdae3f-cf94-414a-9e02-57a60b08ccc2 req-733699a4-9fbf-4f40-ac46-aadb180d142f service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:05.392191 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-5fbdae3f-cf94-414a-9e02-57a60b08ccc2 req-733699a4-9fbf-4f40-ac46-aadb180d142f service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:05.403566 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-5fbdae3f-cf94-414a-9e02-57a60b08ccc2 req-733699a4-9fbf-4f40-ac46-aadb180d142f service nova] Creating event network-vif-deleted:08e2ad33-cf8e-48c5-af02-bfc6e0668156 for instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 on hv-cinder-77957 Aug 24 16:50:05.408251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-5fbdae3f-cf94-414a-9e02-57a60b08ccc2 req-733699a4-9fbf-4f40-ac46-aadb180d142f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093347 Aug 24 16:50:05.408893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 453/911] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:05.681338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:05.681978 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:05.688755 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:05.689245 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:05.689677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:05.690379 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:05.690836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:05.691259 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:05.723323 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:05.724631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:05.725077 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:05.725530 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lazy-loading 'fault' on Instance uuid 3c16b9f1-a570-4574-9f31-55ee4d2c0345 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:50:05.766343 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5d3834f04142e288c04cc05665329f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c99de6ca9094fa7bd119a3be6817725', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:05.774596 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-565a6ab4-4490-4c2a-9702-4c65fc4e3d7d tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 200 len: 1231 microversion: 2.1 time: 0.097114 Aug 24 16:50:05.775156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 459/912] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:05 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:06.797615 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:06.798317 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 3c16b9f1-a570-4574-9f31-55ee4d2c0345] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:06.804797 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:06.805286 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:06.805722 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:06.806415 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:06.806873 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:06.807301 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:06.821080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] HTTP exception thrown: Instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 could not be found. Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Request method failure captured: Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 HTTP/1.1 Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlTz42ucFQOgcikyVSr4o5VXyZ_N2xwj4hT0vEl60zJ-iZcygcpxmXVbsYVLxSmRjbOWNvNyA3JrS70vIa5M74t7BkFCm_8eXVPYK3j6rlYy2PM2c319d1o7voVuJJWTwZw_SkEJ6FC-VhrIoosXEVvwY7hEuR278wcVBQrN8S3S514 Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 7c99de6ca9094fa7bd119a3be6817725 Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:50:06.822684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7c99de6ca9094fa7bd119a3be6817725", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 7c99de6ca9094fa7bd119a3be6817725 Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-TestVolumeBootPattern-1282274193-project Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: bb5d3834f04142e288c04cc05665329f Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-TestVolumeBootPattern-1282274193-project Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 could not be found. Aug 24 16:50:06.824357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '3c16b9f1-a570-4574-9f31-55ee4d2c0345'} Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 could not be found. Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:06.825218 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 could not be found. Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 could not be found. Aug 24 16:50:06.826492 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:06.827609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Returning 404 to user: Instance 3c16b9f1-a570-4574-9f31-55ee4d2c0345 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:06.827609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0c8e0c65-d24b-48fa-89ae-f7a3b8f6f714 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345" status: 404 len: 111 microversion: 2.1 time: 0.031384 Aug 24 16:50:06.827609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 454/913] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:06 2022] GET /compute/v2.1/servers/3c16b9f1-a570-4574-9f31-55ee4d2c0345 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:07.264508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:07.265012 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:07.270969 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.271460 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.272600 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.273373 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.273830 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.274258 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.287360 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] HTTP exception thrown: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Request method failure captured: Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: DELETE /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 HTTP/1.1 Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlTz42ucFQOgcikyVSr4o5VXyZ_N2xwj4hT0vEl60zJ-iZcygcpxmXVbsYVLxSmRjbOWNvNyA3JrS70vIa5M74t7BkFCm_8eXVPYK3j6rlYy2PM2c319d1o7voVuJJWTwZw_SkEJ6FC-VhrIoosXEVvwY7hEuR278wcVBQrN8S3S514 Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: 7c99de6ca9094fa7bd119a3be6817725 Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:50:07.289003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7c99de6ca9094fa7bd119a3be6817725", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: 7c99de6ca9094fa7bd119a3be6817725 Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-TestVolumeBootPattern-1282274193-project Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: bb5d3834f04142e288c04cc05665329f Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-TestVolumeBootPattern-1282274193-project Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:50:07.290662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '03ba5c9b-d3ec-4458-9ad3-eefdc9882599'} Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:07.291588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:50:07.293188 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:07.294758 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Returning 404 to user: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:07.294758 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5c9b3335-5b3c-43c5-97f0-f5c7ad385ed8 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "DELETE /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 404 len: 111 microversion: 2.1 time: 0.030005 Aug 24 16:50:07.294758 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 460/914] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:50:07 2022] DELETE /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:07.298949 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:07.299692 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] [instance: 03ba5c9b-d3ec-4458-9ad3-eefdc9882599] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:07.306351 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.306843 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.307275 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.308004 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:07.308456 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:07.308999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:07.323021 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] HTTP exception thrown: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Request method failure captured: Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 HTTP/1.1 Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlTz42ucFQOgcikyVSr4o5VXyZ_N2xwj4hT0vEl60zJ-iZcygcpxmXVbsYVLxSmRjbOWNvNyA3JrS70vIa5M74t7BkFCm_8eXVPYK3j6rlYy2PM2c319d1o7voVuJJWTwZw_SkEJ6FC-VhrIoosXEVvwY7hEuR278wcVBQrN8S3S514 Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: 7c99de6ca9094fa7bd119a3be6817725 Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:50:07.324702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c99de6ca9094fa7bd119a3be6817725"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7c99de6ca9094fa7bd119a3be6817725", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: 7c99de6ca9094fa7bd119a3be6817725 Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-TestVolumeBootPattern-1282274193 Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-TestVolumeBootPattern-1282274193-project Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: bb5d3834f04142e288c04cc05665329f Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-TestVolumeBootPattern-1282274193-project Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:50:07.326259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '03ba5c9b-d3ec-4458-9ad3-eefdc9882599'} Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:07.330435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. Aug 24 16:50:07.331659 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:07.333552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Returning 404 to user: Instance 03ba5c9b-d3ec-4458-9ad3-eefdc9882599 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:07.333552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6b5d0496-e91e-4379-abdc-fb92752c1e46 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599" status: 404 len: 111 microversion: 2.1 time: 0.031050 Aug 24 16:50:07.333552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 455/915] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:07 2022] GET /compute/v2.1/servers/03ba5c9b-d3ec-4458-9ad3-eefdc9882599 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:50:08.623328 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1f004084-78b4-497a-9202-eab47baeb488 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] Calling method '.version_select at 0x7f063b41b700>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:08.646011 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1f004084-78b4-497a-9202-eab47baeb488 tempest-TestVolumeBootPattern-1282274193 tempest-TestVolumeBootPattern-1282274193-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1832399109" status: 202 len: 0 microversion: 2.1 time: 0.026345 Aug 24 16:50:08.647614 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 461/916] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Aug 24 16:50:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1832399109 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:50:17.186734 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-610a0973-5f87-4d63-8393-0501b6643aa8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:17.187341 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-610a0973-5f87-4d63-8393-0501b6643aa8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:17.194736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-610a0973-5f87-4d63-8393-0501b6643aa8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:17.194893 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-610a0973-5f87-4d63-8393-0501b6643aa8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:17.195307 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-610a0973-5f87-4d63-8393-0501b6643aa8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:17.196012 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-610a0973-5f87-4d63-8393-0501b6643aa8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:17.196465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-610a0973-5f87-4d63-8393-0501b6643aa8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:17.196880 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-610a0973-5f87-4d63-8393-0501b6643aa8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:17.219698 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-610a0973-5f87-4d63-8393-0501b6643aa8 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/ips" status: 200 len: 145 microversion: 2.1 time: 0.036860 Aug 24 16:50:17.220283 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 456/917] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 16:50:17 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:18.551638 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-08d38017-594c-43ae-9580-13fc1d0f33a0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20bf3b63-4165-4d2f-92a3-6f396ee7651c"}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:18.554348 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-08d38017-594c-43ae-9580-13fc1d0f33a0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:18.556524 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:18.563347 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-08d38017-594c-43ae-9580-13fc1d0f33a0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:18.563905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-08d38017-594c-43ae-9580-13fc1d0f33a0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:18.564360 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-08d38017-594c-43ae-9580-13fc1d0f33a0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:18.565052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-08d38017-594c-43ae-9580-13fc1d0f33a0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:18.565499 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-08d38017-594c-43ae-9580-13fc1d0f33a0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:18.565919 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-08d38017-594c-43ae-9580-13fc1d0f33a0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:18.818061 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-08d38017-594c-43ae-9580-13fc1d0f33a0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270587 Aug 24 16:50:18.818675 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 462/918] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:50:18 2022] POST /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:25.289058 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-a573f8ec-a4e0-4224-ba46-cf1814b84825 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:25.291225 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-a573f8ec-a4e0-4224-ba46-cf1814b84825 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:25.297259 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a573f8ec-a4e0-4224-ba46-cf1814b84825 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:25.297747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a573f8ec-a4e0-4224-ba46-cf1814b84825 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:25.298185 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a573f8ec-a4e0-4224-ba46-cf1814b84825 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:25.298881 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a573f8ec-a4e0-4224-ba46-cf1814b84825 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:25.299337 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a573f8ec-a4e0-4224-ba46-cf1814b84825 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:25.299765 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-a573f8ec-a4e0-4224-ba46-cf1814b84825 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:25.329408 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-a573f8ec-a4e0-4224-ba46-cf1814b84825 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044978 Aug 24 16:50:25.329947 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 457/919] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:50:25 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:25.341900 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-69d136b2-22a0-410e-a430-46e4b98ee2f0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:25.342552 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-69d136b2-22a0-410e-a430-46e4b98ee2f0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:25.348799 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-69d136b2-22a0-410e-a430-46e4b98ee2f0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:25.349286 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-69d136b2-22a0-410e-a430-46e4b98ee2f0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:25.349718 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-69d136b2-22a0-410e-a430-46e4b98ee2f0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:25.350976 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-69d136b2-22a0-410e-a430-46e4b98ee2f0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:25.351470 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-69d136b2-22a0-410e-a430-46e4b98ee2f0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:25.351896 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-69d136b2-22a0-410e-a430-46e4b98ee2f0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:25.380484 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-69d136b2-22a0-410e-a430-46e4b98ee2f0 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments/20bf3b63-4165-4d2f-92a3-6f396ee7651c" status: 200 len: 194 microversion: 2.1 time: 0.043475 Aug 24 16:50:25.381057 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 463/920] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Aug 24 16:50:25 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments/20bf3b63-4165-4d2f-92a3-6f396ee7651c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:26.712211 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-7997182e-decc-47fb-bc4a-c9c366eaa7c6 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "809f1cbf-cd36-45aa-a668-731c889c005e"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:26.714538 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-7997182e-decc-47fb-bc4a-c9c366eaa7c6 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:26.716908 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=23 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:26.722021 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7997182e-decc-47fb-bc4a-c9c366eaa7c6 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:26.722503 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7997182e-decc-47fb-bc4a-c9c366eaa7c6 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:26.722935 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7997182e-decc-47fb-bc4a-c9c366eaa7c6 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:26.723621 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7997182e-decc-47fb-bc4a-c9c366eaa7c6 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:26.724106 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7997182e-decc-47fb-bc4a-c9c366eaa7c6 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:26.724525 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-7997182e-decc-47fb-bc4a-c9c366eaa7c6 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:26.727678 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=37 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:26.971928 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-7997182e-decc-47fb-bc4a-c9c366eaa7c6 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "POST /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264378 Aug 24 16:50:26.972562 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 458/921] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:50:26 2022] POST /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:34.503376 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-85a85bdb-e62b-4297-9498-a568caa0aeec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:34.505520 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-85a85bdb-e62b-4297-9498-a568caa0aeec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:34.508588 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:34.515910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85a85bdb-e62b-4297-9498-a568caa0aeec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:34.516419 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85a85bdb-e62b-4297-9498-a568caa0aeec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:34.516848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85a85bdb-e62b-4297-9498-a568caa0aeec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:34.517545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85a85bdb-e62b-4297-9498-a568caa0aeec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:34.517989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85a85bdb-e62b-4297-9498-a568caa0aeec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:34.518407 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-85a85bdb-e62b-4297-9498-a568caa0aeec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:34.549857 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-85a85bdb-e62b-4297-9498-a568caa0aeec tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050255 Aug 24 16:50:34.550646 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 464/922] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:50:34 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:34.718301 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-06bfb095-9a14-4060-8dd9-40fbd053522a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:34.718848 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-06bfb095-9a14-4060-8dd9-40fbd053522a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:34.724997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06bfb095-9a14-4060-8dd9-40fbd053522a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:34.725482 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06bfb095-9a14-4060-8dd9-40fbd053522a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:34.725919 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06bfb095-9a14-4060-8dd9-40fbd053522a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:34.726674 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06bfb095-9a14-4060-8dd9-40fbd053522a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:34.727131 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06bfb095-9a14-4060-8dd9-40fbd053522a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:34.727611 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-06bfb095-9a14-4060-8dd9-40fbd053522a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:34.757170 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-06bfb095-9a14-4060-8dd9-40fbd053522a tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments/20bf3b63-4165-4d2f-92a3-6f396ee7651c" status: 200 len: 194 microversion: 2.1 time: 0.043892 Aug 24 16:50:34.758882 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 459/923] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Aug 24 16:50:34 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments/20bf3b63-4165-4d2f-92a3-6f396ee7651c => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:34.769158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-bac8ec48-c01c-4232-bca9-03a1c1b7a292 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:34.769648 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-bac8ec48-c01c-4232-bca9-03a1c1b7a292 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:34.776539 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bac8ec48-c01c-4232-bca9-03a1c1b7a292 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:34.777054 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bac8ec48-c01c-4232-bca9-03a1c1b7a292 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:34.777490 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bac8ec48-c01c-4232-bca9-03a1c1b7a292 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:34.778179 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bac8ec48-c01c-4232-bca9-03a1c1b7a292 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:34.778631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bac8ec48-c01c-4232-bca9-03a1c1b7a292 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:34.779050 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bac8ec48-c01c-4232-bca9-03a1c1b7a292 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:34.863456 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-bac8ec48-c01c-4232-bca9-03a1c1b7a292 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lazy-loading 'services' on Instance uuid 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:50:34.936060 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-bac8ec48-c01c-4232-bca9-03a1c1b7a292 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments/20bf3b63-4165-4d2f-92a3-6f396ee7651c" status: 202 len: 0 microversion: 2.1 time: 0.170515 Aug 24 16:50:34.936642 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 465/924] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:50:34 2022] DELETE /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments/20bf3b63-4165-4d2f-92a3-6f396ee7651c => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:50:36.059453 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-31ffe3e4-3f89-405e-9d6f-0b725dc0f6b3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:36.060020 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-31ffe3e4-3f89-405e-9d6f-0b725dc0f6b3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:36.066302 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-31ffe3e4-3f89-405e-9d6f-0b725dc0f6b3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:36.066795 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-31ffe3e4-3f89-405e-9d6f-0b725dc0f6b3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:36.067238 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-31ffe3e4-3f89-405e-9d6f-0b725dc0f6b3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:36.067931 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-31ffe3e4-3f89-405e-9d6f-0b725dc0f6b3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:36.068421 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-31ffe3e4-3f89-405e-9d6f-0b725dc0f6b3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:36.068848 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-31ffe3e4-3f89-405e-9d6f-0b725dc0f6b3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:36.097859 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-31ffe3e4-3f89-405e-9d6f-0b725dc0f6b3 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments/809f1cbf-cd36-45aa-a668-731c889c005e" status: 200 len: 194 microversion: 2.1 time: 0.042394 Aug 24 16:50:36.098441 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 460/925] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Aug 24 16:50:36 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments/809f1cbf-cd36-45aa-a668-731c889c005e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:36.110095 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-cd64d3bb-1e51-4b65-970b-41a8ef510c45 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:36.110670 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-cd64d3bb-1e51-4b65-970b-41a8ef510c45 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:36.116792 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cd64d3bb-1e51-4b65-970b-41a8ef510c45 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:36.118629 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cd64d3bb-1e51-4b65-970b-41a8ef510c45 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:36.119074 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cd64d3bb-1e51-4b65-970b-41a8ef510c45 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:36.119779 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cd64d3bb-1e51-4b65-970b-41a8ef510c45 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:36.120261 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cd64d3bb-1e51-4b65-970b-41a8ef510c45 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:36.120684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-cd64d3bb-1e51-4b65-970b-41a8ef510c45 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:36.204372 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-cd64d3bb-1e51-4b65-970b-41a8ef510c45 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lazy-loading 'services' on Instance uuid 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:50:36.275226 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-cd64d3bb-1e51-4b65-970b-41a8ef510c45 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments/809f1cbf-cd36-45aa-a668-731c889c005e" status: 202 len: 0 microversion: 2.1 time: 0.169545 Aug 24 16:50:36.275799 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 466/926] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:50:36 2022] DELETE /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments/809f1cbf-cd36-45aa-a668-731c889c005e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:50:37.442936 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8a3aaf26-e0d7-4106-8e34-e9d5af708267 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:37.445785 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8a3aaf26-e0d7-4106-8e34-e9d5af708267 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:37.452177 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3aaf26-e0d7-4106-8e34-e9d5af708267 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:37.452668 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3aaf26-e0d7-4106-8e34-e9d5af708267 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:37.453108 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3aaf26-e0d7-4106-8e34-e9d5af708267 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:37.453804 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3aaf26-e0d7-4106-8e34-e9d5af708267 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:37.454264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3aaf26-e0d7-4106-8e34-e9d5af708267 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:37.454692 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8a3aaf26-e0d7-4106-8e34-e9d5af708267 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:37.483465 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8a3aaf26-e0d7-4106-8e34-e9d5af708267 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044526 Aug 24 16:50:37.484021 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 461/927] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:50:37 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:50:37.606570 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c4e5aa33-e413-4e8c-80bb-bddd27dafc12 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:37.608893 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c4e5aa33-e413-4e8c-80bb-bddd27dafc12 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:37.615028 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4e5aa33-e413-4e8c-80bb-bddd27dafc12 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:37.615511 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4e5aa33-e413-4e8c-80bb-bddd27dafc12 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:37.616025 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4e5aa33-e413-4e8c-80bb-bddd27dafc12 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:37.616662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4e5aa33-e413-4e8c-80bb-bddd27dafc12 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:37.617720 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4e5aa33-e413-4e8c-80bb-bddd27dafc12 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:37.618149 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c4e5aa33-e413-4e8c-80bb-bddd27dafc12 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:37.646460 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c4e5aa33-e413-4e8c-80bb-bddd27dafc12 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044900 Aug 24 16:50:37.647016 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 467/928] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:50:37 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:50:37.707474 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-53fe14df-c3ee-4391-a58a-482f22d5c432 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:37.707990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-53fe14df-c3ee-4391-a58a-482f22d5c432 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:37.714670 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53fe14df-c3ee-4391-a58a-482f22d5c432 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:37.715159 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53fe14df-c3ee-4391-a58a-482f22d5c432 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:37.715597 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53fe14df-c3ee-4391-a58a-482f22d5c432 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:37.716328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53fe14df-c3ee-4391-a58a-482f22d5c432 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:37.716787 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53fe14df-c3ee-4391-a58a-482f22d5c432 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:37.717215 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53fe14df-c3ee-4391-a58a-482f22d5c432 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:37.741611 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-53fe14df-c3ee-4391-a58a-482f22d5c432 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:50:37.814342 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-53fe14df-c3ee-4391-a58a-482f22d5c432 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 204 len: 0 microversion: 2.1 time: 0.110415 Aug 24 16:50:37.815131 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 462/929] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:50:37 2022] DELETE /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:37.823899 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-fa5c01f8-daf7-44ac-aa15-800c4b8488f7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:37.824533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-fa5c01f8-daf7-44ac-aa15-800c4b8488f7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:37.830459 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fa5c01f8-daf7-44ac-aa15-800c4b8488f7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:37.830946 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fa5c01f8-daf7-44ac-aa15-800c4b8488f7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:37.831384 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fa5c01f8-daf7-44ac-aa15-800c4b8488f7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:37.832112 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fa5c01f8-daf7-44ac-aa15-800c4b8488f7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:37.832567 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fa5c01f8-daf7-44ac-aa15-800c4b8488f7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:37.832989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-fa5c01f8-daf7-44ac-aa15-800c4b8488f7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:37.963978 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-fa5c01f8-daf7-44ac-aa15-800c4b8488f7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:37.971565 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-fa5c01f8-daf7-44ac-aa15-800c4b8488f7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1671 microversion: 2.1 time: 0.152216 Aug 24 16:50:37.972152 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 468/930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:37 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:38.994755 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6765781e-a583-4410-881f-6a808f4d1ba2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:38.995452 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6765781e-a583-4410-881f-6a808f4d1ba2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:39.001861 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6765781e-a583-4410-881f-6a808f4d1ba2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:39.002344 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6765781e-a583-4410-881f-6a808f4d1ba2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:39.002773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6765781e-a583-4410-881f-6a808f4d1ba2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:39.003466 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6765781e-a583-4410-881f-6a808f4d1ba2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:39.003920 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6765781e-a583-4410-881f-6a808f4d1ba2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:39.004364 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6765781e-a583-4410-881f-6a808f4d1ba2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:39.133733 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6765781e-a583-4410-881f-6a808f4d1ba2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:39.142193 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6765781e-a583-4410-881f-6a808f4d1ba2 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1671 microversion: 2.1 time: 0.152632 Aug 24 16:50:39.142757 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 463/931] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:38 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:40.163821 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-001f6750-e0ff-4f0a-99d7-e8273d34e782 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:40.164513 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-001f6750-e0ff-4f0a-99d7-e8273d34e782 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:40.170944 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-001f6750-e0ff-4f0a-99d7-e8273d34e782 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:40.171434 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-001f6750-e0ff-4f0a-99d7-e8273d34e782 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:40.171868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-001f6750-e0ff-4f0a-99d7-e8273d34e782 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:40.172599 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-001f6750-e0ff-4f0a-99d7-e8273d34e782 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:40.173054 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-001f6750-e0ff-4f0a-99d7-e8273d34e782 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:40.173479 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-001f6750-e0ff-4f0a-99d7-e8273d34e782 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:40.316955 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-001f6750-e0ff-4f0a-99d7-e8273d34e782 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481ae20977e8424cb460d8108905577d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd03bbf32154ccabb8d233f00347081', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:40.326112 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-001f6750-e0ff-4f0a-99d7-e8273d34e782 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 200 len: 1671 microversion: 2.1 time: 0.166052 Aug 24 16:50:40.326737 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 469/932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:40 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:40.655505 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-32931fec-ca11-407a-b4b8-147df03d9491 req-be8288a5-25ed-4489-826f-8c9c7fbfc9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63", "name": "network-vif-deleted", "tag": "adfa3691-d4e0-43f8-8b83-df9b96c5701c"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:40.668869 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-32931fec-ca11-407a-b4b8-147df03d9491 req-be8288a5-25ed-4489-826f-8c9c7fbfc9ac service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:40.670450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-32931fec-ca11-407a-b4b8-147df03d9491 req-be8288a5-25ed-4489-826f-8c9c7fbfc9ac service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:40.670924 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-32931fec-ca11-407a-b4b8-147df03d9491 req-be8288a5-25ed-4489-826f-8c9c7fbfc9ac service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:40.687086 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-32931fec-ca11-407a-b4b8-147df03d9491 req-be8288a5-25ed-4489-826f-8c9c7fbfc9ac service nova] Creating event network-vif-deleted:adfa3691-d4e0-43f8-8b83-df9b96c5701c for instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 on hv-cinder-77957 Aug 24 16:50:40.695140 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-32931fec-ca11-407a-b4b8-147df03d9491 req-be8288a5-25ed-4489-826f-8c9c7fbfc9ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043399 Aug 24 16:50:40.697279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 464/933] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:41.353046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:41.353745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:41.360384 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:41.360951 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:41.361476 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:41.362242 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:41.362763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:41.363249 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:41.377746 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] HTTP exception thrown: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Request method failure captured: Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 HTTP/1.1 Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlX1XB-moZkqHKxHm26Cv6FmrV_toO80CieMwI0dv18X7ISxMo0XMSMVzCF1EWK0fah7Q3PPXv88YTR0dD__J2DC2lvm8Je_unKGq1VfNdViGTqA1SAWr3V0oIEQ-iHosOVO0ZFxSrE0w4mwh-zDL4VJRZoFrFfU3Zx2QPxog0oqMNM Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:50:41.379482 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd03bbf32154ccabb8d233f00347081", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 481ae20977e8424cb460d8108905577d Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:41.381251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63'} Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:41.382222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:41.384526 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:41.385858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Returning 404 to user: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:41.385858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-62a7bd32-bb90-49a8-8cb7-2b03c985bed7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 404 len: 111 microversion: 2.1 time: 0.032691 Aug 24 16:50:41.385858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 470/934] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:41 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:41.390836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-15a58fa0-0d55-4113-bdb0-158757dfe881 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '.version_select at 0x7f063aac9b80>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:41.410635 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-15a58fa0-0d55-4113-bdb0-158757dfe881 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459081915" status: 202 len: 0 microversion: 2.1 time: 0.024158 Aug 24 16:50:41.411206 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 465/935] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Aug 24 16:50:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459081915 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:50:44.317595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:44.318100 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:44.324420 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:44.324903 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:44.325338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:44.326032 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:44.326485 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:44.326907 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:44.339911 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] HTTP exception thrown: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Request method failure captured: Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: DELETE /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 HTTP/1.1 Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlX1XB-moZkqHKxHm26Cv6FmrV_toO80CieMwI0dv18X7ISxMo0XMSMVzCF1EWK0fah7Q3PPXv88YTR0dD__J2DC2lvm8Je_unKGq1VfNdViGTqA1SAWr3V0oIEQ-iHosOVO0ZFxSrE0w4mwh-zDL4VJRZoFrFfU3Zx2QPxog0oqMNM Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:50:44.341472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd03bbf32154ccabb8d233f00347081", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 481ae20977e8424cb460d8108905577d Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:44.343076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63'} Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:44.344083 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:44.345555 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:44.347039 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Returning 404 to user: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:44.347039 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-0fa59c15-91ec-4d99-a4e8-ddf34d173b5c tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 404 len: 111 microversion: 2.1 time: 0.029062 Aug 24 16:50:44.347039 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 471/936] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:50:44 2022] DELETE /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:44.352346 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:44.352963 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:44.359780 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:44.360395 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:44.360839 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:44.361537 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:44.362000 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:44.362429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:44.376530 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] HTTP exception thrown: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Request method failure captured: Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 HTTP/1.1 Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlX1XB-moZkqHKxHm26Cv6FmrV_toO80CieMwI0dv18X7ISxMo0XMSMVzCF1EWK0fah7Q3PPXv88YTR0dD__J2DC2lvm8Je_unKGq1VfNdViGTqA1SAWr3V0oIEQ-iHosOVO0ZFxSrE0w4mwh-zDL4VJRZoFrFfU3Zx2QPxog0oqMNM Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:50:44.378279 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd03bbf32154ccabb8d233f00347081", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 481ae20977e8424cb460d8108905577d Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:44.380842 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63'} Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:44.382499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. Aug 24 16:50:44.385815 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:44.388248 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Returning 404 to user: Instance 7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:44.388248 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-58382da3-9573-492a-aac7-6a457771e1ad tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63" status: 404 len: 111 microversion: 2.1 time: 0.032398 Aug 24 16:50:44.388248 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 466/937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:44 2022] GET /compute/v2.1/servers/7da8cf35-3e06-4c0b-8de3-2bd3fcc96a63 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:45.519054 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:45.519548 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:45.527278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:45.527763 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:45.528218 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:45.528905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:45.529392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:45.529812 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:45.543095 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] HTTP exception thrown: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Request method failure captured: Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: DELETE /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e HTTP/1.1 Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlX1XB-moZkqHKxHm26Cv6FmrV_toO80CieMwI0dv18X7ISxMo0XMSMVzCF1EWK0fah7Q3PPXv88YTR0dD__J2DC2lvm8Je_unKGq1VfNdViGTqA1SAWr3V0oIEQ-iHosOVO0ZFxSrE0w4mwh-zDL4VJRZoFrFfU3Zx2QPxog0oqMNM Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:50:45.544671 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd03bbf32154ccabb8d233f00347081", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 481ae20977e8424cb460d8108905577d Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:50:45.546353 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'c945bfc4-12ec-45eb-83b6-9e1c55d54e0e'} Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:45.547274 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:50:45.548806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:50:45.550697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Returning 404 to user: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:45.550697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-12d11551-0c4e-4064-84fb-e8036f567064 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 404 len: 111 microversion: 2.1 time: 0.030846 Aug 24 16:50:45.550697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 472/938] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:50:45 2022] DELETE /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:45.554973 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:45.555590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] [instance: c945bfc4-12ec-45eb-83b6-9e1c55d54e0e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:45.561885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:45.562374 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:45.562808 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:45.563504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:45.563981 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:45.564413 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:45.577843 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] HTTP exception thrown: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Request method failure captured: Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e HTTP/1.1 Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlX1XB-moZkqHKxHm26Cv6FmrV_toO80CieMwI0dv18X7ISxMo0XMSMVzCF1EWK0fah7Q3PPXv88YTR0dD__J2DC2lvm8Je_unKGq1VfNdViGTqA1SAWr3V0oIEQ-iHosOVO0ZFxSrE0w4mwh-zDL4VJRZoFrFfU3Zx2QPxog0oqMNM Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:50:45.579385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ebd03bbf32154ccabb8d233f00347081"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ebd03bbf32154ccabb8d233f00347081", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: ebd03bbf32154ccabb8d233f00347081 Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1041041114 Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 481ae20977e8424cb460d8108905577d Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeTestJSON-1041041114-project Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:50:45.580990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'c945bfc4-12ec-45eb-83b6-9e1c55d54e0e'} Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:50:45.581990 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. Aug 24 16:50:45.583769 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:50:45.585360 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] Returning 404 to user: Instance c945bfc4-12ec-45eb-83b6-9e1c55d54e0e could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:50:45.585360 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ec5baf1f-2feb-4b26-844e-3119aea3a9b7 tempest-AttachVolumeTestJSON-1041041114 tempest-AttachVolumeTestJSON-1041041114-project] 10.222.0.52 "GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e" status: 404 len: 111 microversion: 2.1 time: 0.030063 Aug 24 16:50:45.585360 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 467/939] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:45 2022] GET /compute/v2.1/servers/c945bfc4-12ec-45eb-83b6-9e1c55d54e0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:50:54.119319 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f8ab0aac-6128-48c9-a80c-7402f5e0af56 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: .version_select at 0x7f063aa02d30>, body: {"keypair": {"name": "tempest-keypair-949815170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi7/lNxgyAtQpReBzugCsAX/lX9/aiD9kNNvmAybpIPaGr/JvJNzwfxgxTOPLwuVfRP7mzPytD6UeF1s5LvyF2fgWpq2tanEWrRA4QpGg8aWL0nhS1ZEoTch5Xt5ovqUw=="}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:54.135203 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-f8ab0aac-6128-48c9-a80c-7402f5e0af56 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:50:54.139794 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-f8ab0aac-6128-48c9-a80c-7402f5e0af56 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for user 0de20b3d10414699bec5a6eaf15f1aa3 and project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:50:54.176406 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f8ab0aac-6128-48c9-a80c-7402f5e0af56 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183568 Aug 24 16:50:54.177533 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 473/940] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 16:50:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:50:55.539535 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-93139219", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea37bb26-b217-49f5-97d7-1c427cd1945c"}], "security_groups": [{"name": "tempest-securitygroup--323501722"}], "key_name": "tempest-keypair-949815170", "user_data": "}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:50:55.572115 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:55.652378 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] validate_networks() for [('ea37bb26-b217-49f5-97d7-1c427cd1945c', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:50:56.028326 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:50:56.028762 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:50:56.029241 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:50:56.029654 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:50:56.030069 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:50:56.040164 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:56.040685 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:56.041122 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:56.041878 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:50:56.042337 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:50:56.042764 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:50:56.059967 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:50:56.063927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for user 0de20b3d10414699bec5a6eaf15f1aa3 and project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:50:56.074882 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:50:56.077251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:50:56.125223 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-aafac91a-38a1-4e9b-80f0-e900de080bb7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.590072 Aug 24 16:50:56.125879 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 468/941] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:50:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:50:56.134824 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:56.140223 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b4621f88-7aeb-4b83-a7e5-c9385199932b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:56.140843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b4621f88-7aeb-4b83-a7e5-c9385199932b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:56.199899 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b4621f88-7aeb-4b83-a7e5-c9385199932b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:56.206967 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b4621f88-7aeb-4b83-a7e5-c9385199932b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1239 microversion: 2.1 time: 0.073839 Aug 24 16:50:56.207486 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 474/942] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:56 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:57.228133 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-dc2566cd-1a55-40e4-9c9d-1e5257656218 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:57.228759 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-dc2566cd-1a55-40e4-9c9d-1e5257656218 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:57.230819 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:57.316589 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-dc2566cd-1a55-40e4-9c9d-1e5257656218 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:57.327405 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-dc2566cd-1a55-40e4-9c9d-1e5257656218 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1239 microversion: 2.1 time: 0.104501 Aug 24 16:50:57.330311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 469/943] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:57 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1239 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:58.348523 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4a251b82-4a1c-42df-a359-5e57e43f3f37 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:58.349072 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-4a251b82-4a1c-42df-a359-5e57e43f3f37 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:58.403418 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-4a251b82-4a1c-42df-a359-5e57e43f3f37 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:58.410227 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-4a251b82-4a1c-42df-a359-5e57e43f3f37 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1239 microversion: 2.1 time: 0.065854 Aug 24 16:50:58.410789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 475/944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:58 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:59.433466 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4f4f8783-7066-41a4-85eb-5bf30b7383f9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:50:59.434087 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4f4f8783-7066-41a4-85eb-5bf30b7383f9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:50:59.486167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4f4f8783-7066-41a4-85eb-5bf30b7383f9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:50:59.492830 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4f4f8783-7066-41a4-85eb-5bf30b7383f9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1239 microversion: 2.1 time: 0.064955 Aug 24 16:50:59.493386 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 470/945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:50:59 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:00.514112 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5f81809e-1be0-4a2f-9136-9fddb3d7e5b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:00.514720 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5f81809e-1be0-4a2f-9136-9fddb3d7e5b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:00.521894 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f81809e-1be0-4a2f-9136-9fddb3d7e5b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:00.522386 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f81809e-1be0-4a2f-9136-9fddb3d7e5b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:00.522828 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f81809e-1be0-4a2f-9136-9fddb3d7e5b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:00.523524 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f81809e-1be0-4a2f-9136-9fddb3d7e5b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:00.524041 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f81809e-1be0-4a2f-9136-9fddb3d7e5b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:00.524502 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f81809e-1be0-4a2f-9136-9fddb3d7e5b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:00.585272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5f81809e-1be0-4a2f-9136-9fddb3d7e5b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:00.592923 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5f81809e-1be0-4a2f-9136-9fddb3d7e5b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1243 microversion: 2.1 time: 0.083025 Aug 24 16:51:00.593480 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 476/946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:00 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1243 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:01.613265 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-055af48f-0d2a-4f94-a55a-b922f8a49cff tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:01.613872 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-055af48f-0d2a-4f94-a55a-b922f8a49cff tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:01.621172 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-055af48f-0d2a-4f94-a55a-b922f8a49cff tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:01.621654 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-055af48f-0d2a-4f94-a55a-b922f8a49cff tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:01.622085 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-055af48f-0d2a-4f94-a55a-b922f8a49cff tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:01.622771 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-055af48f-0d2a-4f94-a55a-b922f8a49cff tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:01.623224 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-055af48f-0d2a-4f94-a55a-b922f8a49cff tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:01.623644 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-055af48f-0d2a-4f94-a55a-b922f8a49cff tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:01.688629 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-055af48f-0d2a-4f94-a55a-b922f8a49cff tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:01.696294 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-055af48f-0d2a-4f94-a55a-b922f8a49cff tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1297 microversion: 2.1 time: 0.086968 Aug 24 16:51:01.697429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 471/947] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:01 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:02.720722 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-28876995-3921-4c56-be65-44b66a51aa3d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:02.721350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-28876995-3921-4c56-be65-44b66a51aa3d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:02.735360 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28876995-3921-4c56-be65-44b66a51aa3d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:02.735849 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28876995-3921-4c56-be65-44b66a51aa3d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:02.736311 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28876995-3921-4c56-be65-44b66a51aa3d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:02.737016 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28876995-3921-4c56-be65-44b66a51aa3d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:02.737472 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28876995-3921-4c56-be65-44b66a51aa3d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:02.737896 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-28876995-3921-4c56-be65-44b66a51aa3d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:02.871540 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-28876995-3921-4c56-be65-44b66a51aa3d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:02.879901 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-28876995-3921-4c56-be65-44b66a51aa3d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1364 microversion: 2.1 time: 0.164551 Aug 24 16:51:02.880771 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 477/948] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:02 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:03.007969 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-7acd607c-8e9f-4cee-875e-b7d6425795d1 req-fbad1218-eb71-4a90-a83d-7e6e6425945d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89e22b2-b09c-48ff-9378-fba95e34a7ee", "tag": "6348cd60-5f11-4c78-8392-0bcbff6335ed"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:03.019914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-7acd607c-8e9f-4cee-875e-b7d6425795d1 req-fbad1218-eb71-4a90-a83d-7e6e6425945d service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:03.020353 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-7acd607c-8e9f-4cee-875e-b7d6425795d1 req-fbad1218-eb71-4a90-a83d-7e6e6425945d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:03.020983 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-7acd607c-8e9f-4cee-875e-b7d6425795d1 req-fbad1218-eb71-4a90-a83d-7e6e6425945d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:03.034151 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-7acd607c-8e9f-4cee-875e-b7d6425795d1 req-fbad1218-eb71-4a90-a83d-7e6e6425945d service nova] Creating event network-changed:6348cd60-5f11-4c78-8392-0bcbff6335ed for instance b89e22b2-b09c-48ff-9378-fba95e34a7ee on hv-cinder-77957 Aug 24 16:51:03.040058 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-7acd607c-8e9f-4cee-875e-b7d6425795d1 req-fbad1218-eb71-4a90-a83d-7e6e6425945d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038590 Aug 24 16:51:03.042030 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 472/949] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:03.901842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-405e082a-54ff-4a3f-ad5e-1e8afc8b3ec5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:03.902461 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-405e082a-54ff-4a3f-ad5e-1e8afc8b3ec5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:03.909050 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-405e082a-54ff-4a3f-ad5e-1e8afc8b3ec5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:03.909545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-405e082a-54ff-4a3f-ad5e-1e8afc8b3ec5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:03.909984 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-405e082a-54ff-4a3f-ad5e-1e8afc8b3ec5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:03.910679 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-405e082a-54ff-4a3f-ad5e-1e8afc8b3ec5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:03.911134 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-405e082a-54ff-4a3f-ad5e-1e8afc8b3ec5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:03.911559 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-405e082a-54ff-4a3f-ad5e-1e8afc8b3ec5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:04.042146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-405e082a-54ff-4a3f-ad5e-1e8afc8b3ec5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:04.049896 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-405e082a-54ff-4a3f-ad5e-1e8afc8b3ec5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1364 microversion: 2.1 time: 0.151990 Aug 24 16:51:04.050468 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 478/950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:03 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:05.072371 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1d7aac57-1b70-49b0-9087-cc20432ad0cb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:05.073067 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1d7aac57-1b70-49b0-9087-cc20432ad0cb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:05.079445 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d7aac57-1b70-49b0-9087-cc20432ad0cb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:05.079963 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d7aac57-1b70-49b0-9087-cc20432ad0cb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:05.080419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d7aac57-1b70-49b0-9087-cc20432ad0cb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:05.081118 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d7aac57-1b70-49b0-9087-cc20432ad0cb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:05.081572 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d7aac57-1b70-49b0-9087-cc20432ad0cb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:05.081996 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1d7aac57-1b70-49b0-9087-cc20432ad0cb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:05.219702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1d7aac57-1b70-49b0-9087-cc20432ad0cb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:05.227156 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1d7aac57-1b70-49b0-9087-cc20432ad0cb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1364 microversion: 2.1 time: 0.159993 Aug 24 16:51:05.227720 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 473/951] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:05 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:06.248845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-98816089-cd68-4805-9f32-102a1d76f269 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:06.249488 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-98816089-cd68-4805-9f32-102a1d76f269 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:06.251919 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:06.257760 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98816089-cd68-4805-9f32-102a1d76f269 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:06.258277 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98816089-cd68-4805-9f32-102a1d76f269 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:06.258790 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98816089-cd68-4805-9f32-102a1d76f269 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:06.259651 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98816089-cd68-4805-9f32-102a1d76f269 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:06.260130 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98816089-cd68-4805-9f32-102a1d76f269 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:06.260547 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98816089-cd68-4805-9f32-102a1d76f269 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:06.390890 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-98816089-cd68-4805-9f32-102a1d76f269 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:06.398442 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-98816089-cd68-4805-9f32-102a1d76f269 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1364 microversion: 2.1 time: 0.153471 Aug 24 16:51:06.399010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 479/952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:06 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:07.420184 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b123fe6d-fc50-46a1-afa0-b64e5da49313 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:07.420819 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b123fe6d-fc50-46a1-afa0-b64e5da49313 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:07.422793 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:07.428420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b123fe6d-fc50-46a1-afa0-b64e5da49313 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:07.428905 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b123fe6d-fc50-46a1-afa0-b64e5da49313 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:07.429360 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b123fe6d-fc50-46a1-afa0-b64e5da49313 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:07.430033 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b123fe6d-fc50-46a1-afa0-b64e5da49313 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:07.430487 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b123fe6d-fc50-46a1-afa0-b64e5da49313 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:07.430916 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b123fe6d-fc50-46a1-afa0-b64e5da49313 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:07.561876 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-b123fe6d-fc50-46a1-afa0-b64e5da49313 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:07.569447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b123fe6d-fc50-46a1-afa0-b64e5da49313 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1364 microversion: 2.1 time: 0.153167 Aug 24 16:51:07.570008 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 474/953] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:07 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:08.240043 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-84467b9e-c9df-4dc2-befb-739718234b5d req-5d1745af-ad8b-4433-9767-7741dc94e10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89e22b2-b09c-48ff-9378-fba95e34a7ee", "name": "network-vif-plugged", "status": "completed", "tag": "6348cd60-5f11-4c78-8392-0bcbff6335ed"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:08.251303 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-84467b9e-c9df-4dc2-befb-739718234b5d req-5d1745af-ad8b-4433-9767-7741dc94e10a service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:08.251634 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-84467b9e-c9df-4dc2-befb-739718234b5d req-5d1745af-ad8b-4433-9767-7741dc94e10a service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:08.252240 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-84467b9e-c9df-4dc2-befb-739718234b5d req-5d1745af-ad8b-4433-9767-7741dc94e10a service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:08.264412 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-84467b9e-c9df-4dc2-befb-739718234b5d req-5d1745af-ad8b-4433-9767-7741dc94e10a service nova] Creating event network-vif-plugged:6348cd60-5f11-4c78-8392-0bcbff6335ed for instance b89e22b2-b09c-48ff-9378-fba95e34a7ee on hv-cinder-77957 Aug 24 16:51:08.269443 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-84467b9e-c9df-4dc2-befb-739718234b5d req-5d1745af-ad8b-4433-9767-7741dc94e10a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095374 Aug 24 16:51:08.270029 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 480/954] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:08.591144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1257684a-3ecc-4a1b-85a0-c207bf30d9a7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:08.591751 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1257684a-3ecc-4a1b-85a0-c207bf30d9a7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:08.598086 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1257684a-3ecc-4a1b-85a0-c207bf30d9a7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:08.598563 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1257684a-3ecc-4a1b-85a0-c207bf30d9a7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:08.598991 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1257684a-3ecc-4a1b-85a0-c207bf30d9a7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:08.599669 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1257684a-3ecc-4a1b-85a0-c207bf30d9a7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:08.600156 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1257684a-3ecc-4a1b-85a0-c207bf30d9a7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:08.600580 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1257684a-3ecc-4a1b-85a0-c207bf30d9a7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:08.732829 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1257684a-3ecc-4a1b-85a0-c207bf30d9a7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:08.740429 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1257684a-3ecc-4a1b-85a0-c207bf30d9a7 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1364 microversion: 2.1 time: 0.153670 Aug 24 16:51:08.740998 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 475/955] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:08 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:09.758405 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=8 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:09.763080 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-31deabdb-3b24-4ac1-8c17-cf918c1dc883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:09.764062 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-31deabdb-3b24-4ac1-8c17-cf918c1dc883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:09.770392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31deabdb-3b24-4ac1-8c17-cf918c1dc883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:09.770868 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31deabdb-3b24-4ac1-8c17-cf918c1dc883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:09.771298 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31deabdb-3b24-4ac1-8c17-cf918c1dc883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:09.772010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31deabdb-3b24-4ac1-8c17-cf918c1dc883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:09.772468 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31deabdb-3b24-4ac1-8c17-cf918c1dc883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:09.772891 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-31deabdb-3b24-4ac1-8c17-cf918c1dc883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:09.901064 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-31deabdb-3b24-4ac1-8c17-cf918c1dc883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:09.908625 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-31deabdb-3b24-4ac1-8c17-cf918c1dc883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1364 microversion: 2.1 time: 0.151156 Aug 24 16:51:09.909191 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 481/956] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:09 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:10.929658 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-6fcc8503-86bc-401d-95e6-644b40856d85 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:10.930267 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-6fcc8503-86bc-401d-95e6-644b40856d85 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:10.932664 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=10 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:10.938491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fcc8503-86bc-401d-95e6-644b40856d85 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:10.938969 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fcc8503-86bc-401d-95e6-644b40856d85 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:10.939401 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fcc8503-86bc-401d-95e6-644b40856d85 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:10.940137 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fcc8503-86bc-401d-95e6-644b40856d85 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:10.940591 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fcc8503-86bc-401d-95e6-644b40856d85 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:10.941015 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-6fcc8503-86bc-401d-95e6-644b40856d85 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:11.085369 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-6fcc8503-86bc-401d-95e6-644b40856d85 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:11.093854 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-6fcc8503-86bc-401d-95e6-644b40856d85 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1554 microversion: 2.1 time: 0.168071 Aug 24 16:51:11.094420 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 476/957] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:10 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:11.114067 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e3acc209-b7d9-408c-9261-45cf1bef39e0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:11.114600 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e3acc209-b7d9-408c-9261-45cf1bef39e0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:11.121297 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e3acc209-b7d9-408c-9261-45cf1bef39e0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:11.121783 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e3acc209-b7d9-408c-9261-45cf1bef39e0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:11.122216 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e3acc209-b7d9-408c-9261-45cf1bef39e0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:11.122909 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e3acc209-b7d9-408c-9261-45cf1bef39e0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:11.123362 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e3acc209-b7d9-408c-9261-45cf1bef39e0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:11.123786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e3acc209-b7d9-408c-9261-45cf1bef39e0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:11.201881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e3acc209-b7d9-408c-9261-45cf1bef39e0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091570 Aug 24 16:51:11.202487 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 482/958] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 16:51:11 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:12.431051 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-cba75188-1f51-408d-826f-7fd71fa1b5f6 req-d24c5f2c-0a50-4f25-a175-9e31e4facafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89e22b2-b09c-48ff-9378-fba95e34a7ee", "tag": "6348cd60-5f11-4c78-8392-0bcbff6335ed"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:12.440890 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-cba75188-1f51-408d-826f-7fd71fa1b5f6 req-d24c5f2c-0a50-4f25-a175-9e31e4facafd service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:12.441366 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-cba75188-1f51-408d-826f-7fd71fa1b5f6 req-d24c5f2c-0a50-4f25-a175-9e31e4facafd service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:12.441797 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-cba75188-1f51-408d-826f-7fd71fa1b5f6 req-d24c5f2c-0a50-4f25-a175-9e31e4facafd service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:12.453675 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-cba75188-1f51-408d-826f-7fd71fa1b5f6 req-d24c5f2c-0a50-4f25-a175-9e31e4facafd service nova] Creating event network-changed:6348cd60-5f11-4c78-8392-0bcbff6335ed for instance b89e22b2-b09c-48ff-9378-fba95e34a7ee on hv-cinder-77957 Aug 24 16:51:12.458682 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-cba75188-1f51-408d-826f-7fd71fa1b5f6 req-d24c5f2c-0a50-4f25-a175-9e31e4facafd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095031 Aug 24 16:51:12.459498 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 477/959] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:13.749485 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:51:13.750079 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Wed Aug 24 16:51:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:51:48.208168 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=7 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:48.208935 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=36 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:48.213296 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b830f7ed-ba25-4dd5-957b-8ec23b348403 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:48.213780 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b830f7ed-ba25-4dd5-957b-8ec23b348403 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:48.220395 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b830f7ed-ba25-4dd5-957b-8ec23b348403 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:48.220875 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b830f7ed-ba25-4dd5-957b-8ec23b348403 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:48.221298 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b830f7ed-ba25-4dd5-957b-8ec23b348403 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:48.221977 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b830f7ed-ba25-4dd5-957b-8ec23b348403 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:48.222423 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b830f7ed-ba25-4dd5-957b-8ec23b348403 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:48.222837 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b830f7ed-ba25-4dd5-957b-8ec23b348403 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:48.247363 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b830f7ed-ba25-4dd5-957b-8ec23b348403 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/ips" status: 200 len: 150 microversion: 2.1 time: 0.040944 Aug 24 16:51:48.248423 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 483/960] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 16:51:48 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:49.606811 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=21 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:49.607559 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=36 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:49.611845 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c82551ce-52bc-4568-8885-4c6cb804652c tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55f87246-eb3e-4fb7-b258-18b71cd954ba"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:49.614356 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c82551ce-52bc-4568-8885-4c6cb804652c tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:49.621727 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82551ce-52bc-4568-8885-4c6cb804652c tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:49.622213 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82551ce-52bc-4568-8885-4c6cb804652c tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:49.622647 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82551ce-52bc-4568-8885-4c6cb804652c tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:49.623338 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82551ce-52bc-4568-8885-4c6cb804652c tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:49.623788 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82551ce-52bc-4568-8885-4c6cb804652c tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:49.624235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c82551ce-52bc-4568-8885-4c6cb804652c tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:49.873375 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c82551ce-52bc-4568-8885-4c6cb804652c tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268061 Aug 24 16:51:49.874022 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 478/961] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:51:49 2022] POST /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:57.412382 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b0c40bf4-b0da-40a4-b956-72a12229572f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: .version_select at 0x7f063a9d0820>, body: {"keypair": {"name": "tempest-keypair-660128333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2aJ2OHser4o6tNrfTCfvmqKNwvkMniLYpXyYJhhsC10/Uh8GEft9l1OaUhQZ/IsOUjvUCiJfet2LWRWf62/Ng90Jq0DPxygTK/zC5drJs8LnDnvAdQGbOy90n7tyqmfA=="}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:57.428206 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-b0c40bf4-b0da-40a4-b956-72a12229572f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:51:57.432106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-b0c40bf4-b0da-40a4-b956-72a12229572f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for user 0de20b3d10414699bec5a6eaf15f1aa3 and project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:51:57.453627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b0c40bf4-b0da-40a4-b956-72a12229572f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045280 Aug 24 16:51:57.454215 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 484/962] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 16:51:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:51:58.650928 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-264640237", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea37bb26-b217-49f5-97d7-1c427cd1945c"}], "security_groups": [{"name": "tempest-securitygroup--385343063"}], "key_name": "tempest-keypair-660128333", "user_data": "}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:51:58.755992 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] validate_networks() for [('ea37bb26-b217-49f5-97d7-1c427cd1945c', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:51:59.135700 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:51:59.136149 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:51:59.136624 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:51:59.137035 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:51:59.137442 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:51:59.146357 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:59.146834 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:59.147264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:59.148012 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:51:59.148468 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:51:59.148887 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:51:59.165377 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:51:59.169947 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for user 0de20b3d10414699bec5a6eaf15f1aa3 and project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:51:59.180582 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:51:59.183567 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:51:59.230183 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-357ca38a-7d7f-43a3-b20c-987cb67a3cae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.584340 Aug 24 16:51:59.230836 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 479/963] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:51:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:51:59.240936 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=4 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:59.253277 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-88bef6e0-b6a8-4410-bb59-6308ffb7cb72 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:51:59.253947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-88bef6e0-b6a8-4410-bb59-6308ffb7cb72 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:51:59.312452 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-88bef6e0-b6a8-4410-bb59-6308ffb7cb72 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:51:59.319220 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-88bef6e0-b6a8-4410-bb59-6308ffb7cb72 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1240 microversion: 2.1 time: 0.079103 Aug 24 16:51:59.324299 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 485/964] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:51:59 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:00.341228 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-2a45e5ca-feae-4506-9f36-5faf1ee708c4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:00.342610 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-2a45e5ca-feae-4506-9f36-5faf1ee708c4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:00.349089 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2a45e5ca-feae-4506-9f36-5faf1ee708c4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:00.349575 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2a45e5ca-feae-4506-9f36-5faf1ee708c4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:00.350009 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2a45e5ca-feae-4506-9f36-5faf1ee708c4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:00.351160 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2a45e5ca-feae-4506-9f36-5faf1ee708c4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:00.351632 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2a45e5ca-feae-4506-9f36-5faf1ee708c4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:00.352985 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-2a45e5ca-feae-4506-9f36-5faf1ee708c4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:00.415505 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-2a45e5ca-feae-4506-9f36-5faf1ee708c4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:00.423129 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-2a45e5ca-feae-4506-9f36-5faf1ee708c4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1298 microversion: 2.1 time: 0.087379 Aug 24 16:52:00.423693 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 480/965] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:00 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:01.444120 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-edeea445-eebb-4635-a0b3-dfe10d18ae12 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:01.444733 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-edeea445-eebb-4635-a0b3-dfe10d18ae12 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:01.452346 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-edeea445-eebb-4635-a0b3-dfe10d18ae12 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:01.452836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-edeea445-eebb-4635-a0b3-dfe10d18ae12 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:01.453269 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-edeea445-eebb-4635-a0b3-dfe10d18ae12 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:01.453975 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-edeea445-eebb-4635-a0b3-dfe10d18ae12 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:01.454407 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-edeea445-eebb-4635-a0b3-dfe10d18ae12 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:01.454833 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-edeea445-eebb-4635-a0b3-dfe10d18ae12 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:01.591476 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-e0b3fac4-1b8f-4664-a19f-c5e0f7effd35 req-2769f6d0-fe1d-40fd-b3ad-075b1f9c4cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5453b93-7b3d-485c-850c-5852e89aeecb", "tag": "f9e2d2a7-4ff9-4005-a966-b9bf334d91cf"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:01.600196 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-edeea445-eebb-4635-a0b3-dfe10d18ae12 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:01.610531 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-e0b3fac4-1b8f-4664-a19f-c5e0f7effd35 req-2769f6d0-fe1d-40fd-b3ad-075b1f9c4cd6 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:01.611180 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-e0b3fac4-1b8f-4664-a19f-c5e0f7effd35 req-2769f6d0-fe1d-40fd-b3ad-075b1f9c4cd6 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:01.611898 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-e0b3fac4-1b8f-4664-a19f-c5e0f7effd35 req-2769f6d0-fe1d-40fd-b3ad-075b1f9c4cd6 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:01.612883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-edeea445-eebb-4635-a0b3-dfe10d18ae12 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1365 microversion: 2.1 time: 0.172562 Aug 24 16:52:01.613473 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 486/966] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:01 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:01.624786 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-e0b3fac4-1b8f-4664-a19f-c5e0f7effd35 req-2769f6d0-fe1d-40fd-b3ad-075b1f9c4cd6 service nova] Creating event network-changed:f9e2d2a7-4ff9-4005-a966-b9bf334d91cf for instance e5453b93-7b3d-485c-850c-5852e89aeecb on hv-cinder-77957 Aug 24 16:52:01.630014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-e0b3fac4-1b8f-4664-a19f-c5e0f7effd35 req-2769f6d0-fe1d-40fd-b3ad-075b1f9c4cd6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043180 Aug 24 16:52:01.631974 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 481/967] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:52:02.633282 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-439a6dca-57ef-4987-9325-349999901aa4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:02.633898 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-439a6dca-57ef-4987-9325-349999901aa4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:02.641475 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-439a6dca-57ef-4987-9325-349999901aa4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:02.641959 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-439a6dca-57ef-4987-9325-349999901aa4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:02.642398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-439a6dca-57ef-4987-9325-349999901aa4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:02.643093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-439a6dca-57ef-4987-9325-349999901aa4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:02.643550 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-439a6dca-57ef-4987-9325-349999901aa4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:02.644002 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-439a6dca-57ef-4987-9325-349999901aa4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:02.774684 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-439a6dca-57ef-4987-9325-349999901aa4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:02.782339 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-439a6dca-57ef-4987-9325-349999901aa4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1365 microversion: 2.1 time: 0.152952 Aug 24 16:52:02.782907 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 487/968] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:02 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:03.803901 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-5a8b77e6-acbf-4c08-8f09-a3dfe7705ddb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:03.804621 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-5a8b77e6-acbf-4c08-8f09-a3dfe7705ddb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:03.811885 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a8b77e6-acbf-4c08-8f09-a3dfe7705ddb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:03.812400 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a8b77e6-acbf-4c08-8f09-a3dfe7705ddb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:03.812838 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a8b77e6-acbf-4c08-8f09-a3dfe7705ddb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:03.813528 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a8b77e6-acbf-4c08-8f09-a3dfe7705ddb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:03.813988 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a8b77e6-acbf-4c08-8f09-a3dfe7705ddb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:03.814412 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5a8b77e6-acbf-4c08-8f09-a3dfe7705ddb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:03.945561 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5a8b77e6-acbf-4c08-8f09-a3dfe7705ddb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:03.953907 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-5a8b77e6-acbf-4c08-8f09-a3dfe7705ddb tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1365 microversion: 2.1 time: 0.154318 Aug 24 16:52:03.954464 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 482/969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:03 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:04.974403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-250b1fb4-ffe2-4899-ae23-0f29277f8db3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:04.974997 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-250b1fb4-ffe2-4899-ae23-0f29277f8db3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:04.981563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-250b1fb4-ffe2-4899-ae23-0f29277f8db3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:04.982042 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-250b1fb4-ffe2-4899-ae23-0f29277f8db3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:04.982466 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-250b1fb4-ffe2-4899-ae23-0f29277f8db3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:04.983152 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-250b1fb4-ffe2-4899-ae23-0f29277f8db3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:04.983600 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-250b1fb4-ffe2-4899-ae23-0f29277f8db3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:04.984056 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-250b1fb4-ffe2-4899-ae23-0f29277f8db3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:05.118355 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-250b1fb4-ffe2-4899-ae23-0f29277f8db3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:05.126140 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-250b1fb4-ffe2-4899-ae23-0f29277f8db3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1365 microversion: 2.1 time: 0.155559 Aug 24 16:52:05.126707 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 488/970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:04 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:52:06.147745 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-cf2ff850-f4bc-47b0-9792-7ffe2bbbcbb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:06.148377 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-cf2ff850-f4bc-47b0-9792-7ffe2bbbcbb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:06.155833 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf2ff850-f4bc-47b0-9792-7ffe2bbbcbb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:06.156350 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf2ff850-f4bc-47b0-9792-7ffe2bbbcbb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:06.156780 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf2ff850-f4bc-47b0-9792-7ffe2bbbcbb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:06.157461 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf2ff850-f4bc-47b0-9792-7ffe2bbbcbb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:06.157911 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf2ff850-f4bc-47b0-9792-7ffe2bbbcbb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:06.158331 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-cf2ff850-f4bc-47b0-9792-7ffe2bbbcbb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:06.287816 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-cf2ff850-f4bc-47b0-9792-7ffe2bbbcbb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:06.296450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-cf2ff850-f4bc-47b0-9792-7ffe2bbbcbb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1365 microversion: 2.1 time: 0.152606 Aug 24 16:52:06.297015 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 483/971] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:06 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:06.498315 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-f6c81ce9-a7c7-4e29-9dd1-7ad2aa0956c1 req-8bd6745a-d6b7-469a-a4ab-082ce3cf9a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5453b93-7b3d-485c-850c-5852e89aeecb", "name": "network-vif-plugged", "status": "completed", "tag": "f9e2d2a7-4ff9-4005-a966-b9bf334d91cf"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:06.508181 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-f6c81ce9-a7c7-4e29-9dd1-7ad2aa0956c1 req-8bd6745a-d6b7-469a-a4ab-082ce3cf9a15 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:06.508723 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-f6c81ce9-a7c7-4e29-9dd1-7ad2aa0956c1 req-8bd6745a-d6b7-469a-a4ab-082ce3cf9a15 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:06.509159 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-f6c81ce9-a7c7-4e29-9dd1-7ad2aa0956c1 req-8bd6745a-d6b7-469a-a4ab-082ce3cf9a15 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:06.521251 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-f6c81ce9-a7c7-4e29-9dd1-7ad2aa0956c1 req-8bd6745a-d6b7-469a-a4ab-082ce3cf9a15 service nova] Creating event network-vif-plugged:f9e2d2a7-4ff9-4005-a966-b9bf334d91cf for instance e5453b93-7b3d-485c-850c-5852e89aeecb on hv-cinder-77957 Aug 24 16:52:06.526884 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-f6c81ce9-a7c7-4e29-9dd1-7ad2aa0956c1 req-8bd6745a-d6b7-469a-a4ab-082ce3cf9a15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032186 Aug 24 16:52:06.527547 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 489/972] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:07.317552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-49895d11-d015-4a6c-9ba8-d73178ca89da tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:07.318301 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-49895d11-d015-4a6c-9ba8-d73178ca89da tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:07.325059 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49895d11-d015-4a6c-9ba8-d73178ca89da tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:07.325549 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49895d11-d015-4a6c-9ba8-d73178ca89da tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:07.325985 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49895d11-d015-4a6c-9ba8-d73178ca89da tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:07.326687 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49895d11-d015-4a6c-9ba8-d73178ca89da tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:07.327144 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49895d11-d015-4a6c-9ba8-d73178ca89da tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:07.327570 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-49895d11-d015-4a6c-9ba8-d73178ca89da tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:07.463011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-49895d11-d015-4a6c-9ba8-d73178ca89da tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:07.470697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-49895d11-d015-4a6c-9ba8-d73178ca89da tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1365 microversion: 2.1 time: 0.156996 Aug 24 16:52:07.471254 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 484/973] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:07 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:08.492836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-029e921e-6a07-4f86-a6b5-55926cb36979 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:08.493530 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-029e921e-6a07-4f86-a6b5-55926cb36979 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:08.500402 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-029e921e-6a07-4f86-a6b5-55926cb36979 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:08.500893 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-029e921e-6a07-4f86-a6b5-55926cb36979 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:08.501334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-029e921e-6a07-4f86-a6b5-55926cb36979 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:08.502034 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-029e921e-6a07-4f86-a6b5-55926cb36979 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:08.502491 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-029e921e-6a07-4f86-a6b5-55926cb36979 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:08.502925 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-029e921e-6a07-4f86-a6b5-55926cb36979 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:08.633796 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-029e921e-6a07-4f86-a6b5-55926cb36979 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:08.642600 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-029e921e-6a07-4f86-a6b5-55926cb36979 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1555 microversion: 2.1 time: 0.154515 Aug 24 16:52:08.643164 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 490/974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:08 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:08.663043 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d0f79a46-1665-420b-a59f-5c2c5f46ae43 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:08.663590 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d0f79a46-1665-420b-a59f-5c2c5f46ae43 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:08.670210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d0f79a46-1665-420b-a59f-5c2c5f46ae43 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:08.670691 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d0f79a46-1665-420b-a59f-5c2c5f46ae43 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:08.671125 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d0f79a46-1665-420b-a59f-5c2c5f46ae43 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:08.671816 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d0f79a46-1665-420b-a59f-5c2c5f46ae43 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:08.672299 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d0f79a46-1665-420b-a59f-5c2c5f46ae43 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:08.672724 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d0f79a46-1665-420b-a59f-5c2c5f46ae43 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:08.749226 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d0f79a46-1665-420b-a59f-5c2c5f46ae43 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090033 Aug 24 16:52:08.749845 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 485/975] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 16:52:08 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:09.655738 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-413db4e7-ac03-4ea3-a073-1fe44a79ddf1 req-1421992a-c1d5-4487-b250-753289d77c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5453b93-7b3d-485c-850c-5852e89aeecb", "tag": "f9e2d2a7-4ff9-4005-a966-b9bf334d91cf"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:09.660549 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=6 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:09.667362 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-413db4e7-ac03-4ea3-a073-1fe44a79ddf1 req-1421992a-c1d5-4487-b250-753289d77c41 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:09.667887 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-413db4e7-ac03-4ea3-a073-1fe44a79ddf1 req-1421992a-c1d5-4487-b250-753289d77c41 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:09.668508 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-413db4e7-ac03-4ea3-a073-1fe44a79ddf1 req-1421992a-c1d5-4487-b250-753289d77c41 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:09.679350 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-413db4e7-ac03-4ea3-a073-1fe44a79ddf1 req-1421992a-c1d5-4487-b250-753289d77c41 service nova] Creating event network-changed:f9e2d2a7-4ff9-4005-a966-b9bf334d91cf for instance e5453b93-7b3d-485c-850c-5852e89aeecb on hv-cinder-77957 Aug 24 16:52:09.684385 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-413db4e7-ac03-4ea3-a073-1fe44a79ddf1 req-1421992a-c1d5-4487-b250-753289d77c41 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032282 Aug 24 16:52:09.684967 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 491/976] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:45.566804 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.567564 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=6 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.569080 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.569881 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.578773 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-59e98a05-e439-4325-9b94-155f9b01fb66 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:45.579288 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-59e98a05-e439-4325-9b94-155f9b01fb66 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:45.592045 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-59e98a05-e439-4325-9b94-155f9b01fb66 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.592736 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-59e98a05-e439-4325-9b94-155f9b01fb66 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.593396 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-59e98a05-e439-4325-9b94-155f9b01fb66 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.594650 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-59e98a05-e439-4325-9b94-155f9b01fb66 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.595498 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-59e98a05-e439-4325-9b94-155f9b01fb66 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.596043 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-59e98a05-e439-4325-9b94-155f9b01fb66 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.625122 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-59e98a05-e439-4325-9b94-155f9b01fb66 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb/ips" status: 200 len: 150 microversion: 2.1 time: 0.059121 Aug 24 16:52:45.625690 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 486/977] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 16:52:45 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb/ips => generated 150 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:45.634546 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.635321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=28 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.639888 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55f87246-eb3e-4fb7-b258-18b71cd954ba"}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:45.642254 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:45.649341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.649819 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.650247 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.650966 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.651604 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.652048 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.731517 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Invalid volume: volume 55f87246-eb3e-4fb7-b258-18b71cd954ba is already attached to instances: b89e22b2-b09c-48ff-9378-fba95e34a7ee Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: POST /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb/os-volume_attachments HTTP/1.1 Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 74 Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:52:45.733302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {"volumeAttachment": {"volumeId": "55f87246-eb3e-4fb7-b258-18b71cd954ba"}} Aug 24 16:52:45.735010 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Invalid volume: volume 55f87246-eb3e-4fb7-b258-18b71cd954ba is already attached to instances: b89e22b2-b09c-48ff-9378-fba95e34a7ee Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'server_id': 'e5453b93-7b3d-485c-850c-5852e89aeecb', 'body': {'volumeAttachment': {'volumeId': '55f87246-eb3e-4fb7-b258-18b71cd954ba'}}} Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 55f87246-eb3e-4fb7-b258-18b71cd954ba is already attached to instances: b89e22b2-b09c-48ff-9378-fba95e34a7ee Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:45.735979 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 55f87246-eb3e-4fb7-b258-18b71cd954ba is already attached to instances: b89e22b2-b09c-48ff-9378-fba95e34a7ee Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:45.737283 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:45.738618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:45.738618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:52:45.738618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:52:45.738618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 55f87246-eb3e-4fb7-b258-18b71cd954ba is already attached to instances: b89e22b2-b09c-48ff-9378-fba95e34a7ee Aug 24 16:52:45.738618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:45.738618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 400 to user: Invalid volume: volume 55f87246-eb3e-4fb7-b258-18b71cd954ba is already attached to instances: b89e22b2-b09c-48ff-9378-fba95e34a7ee {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:52:45.738618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-4f3abe8f-c485-4311-a6f6-ac5b62a4a2e5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101700 Aug 24 16:52:45.738618 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 492/978] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:52:45 2022] POST /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:52:45.743656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-157d81ec-0183-4f92-9ab3-2a6bd69dc7b2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:45.744179 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-157d81ec-0183-4f92-9ab3-2a6bd69dc7b2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:45.750987 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-157d81ec-0183-4f92-9ab3-2a6bd69dc7b2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.751477 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-157d81ec-0183-4f92-9ab3-2a6bd69dc7b2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.751915 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-157d81ec-0183-4f92-9ab3-2a6bd69dc7b2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.752660 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-157d81ec-0183-4f92-9ab3-2a6bd69dc7b2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.753118 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-157d81ec-0183-4f92-9ab3-2a6bd69dc7b2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.753541 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-157d81ec-0183-4f92-9ab3-2a6bd69dc7b2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.779303 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-157d81ec-0183-4f92-9ab3-2a6bd69dc7b2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:52:45.854841 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-157d81ec-0183-4f92-9ab3-2a6bd69dc7b2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 204 len: 0 microversion: 2.1 time: 0.114223 Aug 24 16:52:45.855778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 487/979] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:52:45 2022] DELETE /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:52:45.863854 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c9959a0a-2493-4b84-91f4-9e1bfe98371b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:45.864498 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c9959a0a-2493-4b84-91f4-9e1bfe98371b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:45.871870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c9959a0a-2493-4b84-91f4-9e1bfe98371b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.872427 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c9959a0a-2493-4b84-91f4-9e1bfe98371b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.872866 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c9959a0a-2493-4b84-91f4-9e1bfe98371b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:45.873565 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c9959a0a-2493-4b84-91f4-9e1bfe98371b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:45.874023 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c9959a0a-2493-4b84-91f4-9e1bfe98371b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:45.874454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c9959a0a-2493-4b84-91f4-9e1bfe98371b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:46.007395 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c9959a0a-2493-4b84-91f4-9e1bfe98371b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:46.016066 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c9959a0a-2493-4b84-91f4-9e1bfe98371b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1680 microversion: 2.1 time: 0.156080 Aug 24 16:52:46.016627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 493/980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:45 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:47.037713 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c069e5f5-19c0-40df-9376-fad7feb0c739 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:47.038412 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c069e5f5-19c0-40df-9376-fad7feb0c739 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:47.045207 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c069e5f5-19c0-40df-9376-fad7feb0c739 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:47.045684 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c069e5f5-19c0-40df-9376-fad7feb0c739 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:47.046111 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c069e5f5-19c0-40df-9376-fad7feb0c739 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:47.046796 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c069e5f5-19c0-40df-9376-fad7feb0c739 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:47.047241 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c069e5f5-19c0-40df-9376-fad7feb0c739 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:47.047656 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c069e5f5-19c0-40df-9376-fad7feb0c739 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:47.177658 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c069e5f5-19c0-40df-9376-fad7feb0c739 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:47.185405 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c069e5f5-19c0-40df-9376-fad7feb0c739 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1680 microversion: 2.1 time: 0.151997 Aug 24 16:52:47.185973 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 488/981] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:47 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:48.153639 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-3b9c49b0-4b35-4ddf-913b-654c845f17eb req-555e8ee5-139a-41b8-a94e-d5cc8744fbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5453b93-7b3d-485c-850c-5852e89aeecb", "name": "network-vif-deleted", "tag": "f9e2d2a7-4ff9-4005-a966-b9bf334d91cf"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:48.166086 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-3b9c49b0-4b35-4ddf-913b-654c845f17eb req-555e8ee5-139a-41b8-a94e-d5cc8744fbc2 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:48.166490 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-3b9c49b0-4b35-4ddf-913b-654c845f17eb req-555e8ee5-139a-41b8-a94e-d5cc8744fbc2 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:48.166934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-3b9c49b0-4b35-4ddf-913b-654c845f17eb req-555e8ee5-139a-41b8-a94e-d5cc8744fbc2 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:48.179989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-3b9c49b0-4b35-4ddf-913b-654c845f17eb req-555e8ee5-139a-41b8-a94e-d5cc8744fbc2 service nova] Creating event network-vif-deleted:f9e2d2a7-4ff9-4005-a966-b9bf334d91cf for instance e5453b93-7b3d-485c-850c-5852e89aeecb on hv-cinder-77957 Aug 24 16:52:48.186074 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-3b9c49b0-4b35-4ddf-913b-654c845f17eb req-555e8ee5-139a-41b8-a94e-d5cc8744fbc2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036219 Aug 24 16:52:48.186667 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 494/982] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:48.207717 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-aa36dbf4-bc7a-4324-9834-27afb4b1ae75 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:48.211251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-aa36dbf4-bc7a-4324-9834-27afb4b1ae75 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:48.221010 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa36dbf4-bc7a-4324-9834-27afb4b1ae75 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:48.222449 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa36dbf4-bc7a-4324-9834-27afb4b1ae75 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:48.223175 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa36dbf4-bc7a-4324-9834-27afb4b1ae75 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:48.224360 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa36dbf4-bc7a-4324-9834-27afb4b1ae75 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:48.224932 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa36dbf4-bc7a-4324-9834-27afb4b1ae75 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:48.225463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aa36dbf4-bc7a-4324-9834-27afb4b1ae75 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:48.317049 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-aa36dbf4-bc7a-4324-9834-27afb4b1ae75 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:48.329157 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-aa36dbf4-bc7a-4324-9834-27afb4b1ae75 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 200 len: 1325 microversion: 2.1 time: 0.126179 Aug 24 16:52:48.329985 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 489/983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:48 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 1325 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:49.351227 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:49.351911 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:49.358519 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:49.358991 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:49.359452 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:49.360170 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:49.360619 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:49.361035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:49.374222 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb HTTP/1.1 Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:52:49.375858 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:52:49.377545 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'e5453b93-7b3d-485c-850c-5852e89aeecb'} Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:52:49.378578 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:52:49.380108 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:49.381665 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:52:49.381665 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-98eb8726-b06c-4039-aa36-85ff798fb883 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 404 len: 111 microversion: 2.1 time: 0.030898 Aug 24 16:52:49.381665 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 495/984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:49 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:52:49.386552 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-20c85301-d878-4c71-82d4-529c9e316452 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '.version_select at 0x7f0641357280>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:49.405854 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-20c85301-d878-4c71-82d4-529c9e316452 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-660128333" status: 202 len: 0 microversion: 2.1 time: 0.023634 Aug 24 16:52:49.406409 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 490/985] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Aug 24 16:52:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-660128333 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:52:50.074335 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-ea0542c0-cb9c-475a-a98f-e2a921bf8e28 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:50.074857 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-ea0542c0-cb9c-475a-a98f-e2a921bf8e28 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:50.080864 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea0542c0-cb9c-475a-a98f-e2a921bf8e28 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:50.081349 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea0542c0-cb9c-475a-a98f-e2a921bf8e28 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:50.081785 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea0542c0-cb9c-475a-a98f-e2a921bf8e28 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:50.082484 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea0542c0-cb9c-475a-a98f-e2a921bf8e28 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:50.082941 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea0542c0-cb9c-475a-a98f-e2a921bf8e28 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:50.083367 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-ea0542c0-cb9c-475a-a98f-e2a921bf8e28 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:50.165631 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-ea0542c0-cb9c-475a-a98f-e2a921bf8e28 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lazy-loading 'services' on Instance uuid b89e22b2-b09c-48ff-9378-fba95e34a7ee {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:52:50.237015 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-ea0542c0-cb9c-475a-a98f-e2a921bf8e28 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/os-volume_attachments/55f87246-eb3e-4fb7-b258-18b71cd954ba" status: 202 len: 0 microversion: 2.1 time: 0.167220 Aug 24 16:52:50.237649 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 496/986] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:52:50 2022] DELETE /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/os-volume_attachments/55f87246-eb3e-4fb7-b258-18b71cd954ba => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:52:50.246147 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e5cf1fbe-d1a0-4404-a49c-4c5ebc27b7a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:50.248309 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e5cf1fbe-d1a0-4404-a49c-4c5ebc27b7a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:50.254480 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5cf1fbe-d1a0-4404-a49c-4c5ebc27b7a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:50.255002 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5cf1fbe-d1a0-4404-a49c-4c5ebc27b7a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:50.255555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5cf1fbe-d1a0-4404-a49c-4c5ebc27b7a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:50.256444 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5cf1fbe-d1a0-4404-a49c-4c5ebc27b7a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:50.257052 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5cf1fbe-d1a0-4404-a49c-4c5ebc27b7a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:50.257555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5cf1fbe-d1a0-4404-a49c-4c5ebc27b7a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:50.291355 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e5cf1fbe-d1a0-4404-a49c-4c5ebc27b7a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049316 Aug 24 16:52:50.292153 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 491/987] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:52:50 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:51.305297 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2047d168-a03a-434f-8b42-4d51c1d9ebfc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:51.308214 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2047d168-a03a-434f-8b42-4d51c1d9ebfc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:51.314406 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2047d168-a03a-434f-8b42-4d51c1d9ebfc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:51.314883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2047d168-a03a-434f-8b42-4d51c1d9ebfc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:51.315445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2047d168-a03a-434f-8b42-4d51c1d9ebfc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:51.316177 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2047d168-a03a-434f-8b42-4d51c1d9ebfc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:51.316634 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2047d168-a03a-434f-8b42-4d51c1d9ebfc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:51.317051 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2047d168-a03a-434f-8b42-4d51c1d9ebfc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:51.346728 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2047d168-a03a-434f-8b42-4d51c1d9ebfc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046277 Aug 24 16:52:51.347266 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 497/988] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:52:51 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:52:51.408833 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c28ed7a2-93c6-42aa-af66-f302d34969ae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:51.409342 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c28ed7a2-93c6-42aa-af66-f302d34969ae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:51.415749 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c28ed7a2-93c6-42aa-af66-f302d34969ae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:51.416273 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c28ed7a2-93c6-42aa-af66-f302d34969ae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:51.416719 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c28ed7a2-93c6-42aa-af66-f302d34969ae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:51.417941 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c28ed7a2-93c6-42aa-af66-f302d34969ae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:51.418401 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c28ed7a2-93c6-42aa-af66-f302d34969ae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:51.418829 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c28ed7a2-93c6-42aa-af66-f302d34969ae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:51.444293 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c28ed7a2-93c6-42aa-af66-f302d34969ae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:52:51.518860 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c28ed7a2-93c6-42aa-af66-f302d34969ae tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 204 len: 0 microversion: 2.1 time: 0.113543 Aug 24 16:52:51.519637 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 492/989] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:52:51 2022] DELETE /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:52:51.529448 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-12ad037b-95fa-4c17-b479-ad4fece5fcf3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:51.530243 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-12ad037b-95fa-4c17-b479-ad4fece5fcf3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:51.536368 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12ad037b-95fa-4c17-b479-ad4fece5fcf3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:51.536855 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12ad037b-95fa-4c17-b479-ad4fece5fcf3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:51.537294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12ad037b-95fa-4c17-b479-ad4fece5fcf3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:51.537992 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12ad037b-95fa-4c17-b479-ad4fece5fcf3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:51.538448 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12ad037b-95fa-4c17-b479-ad4fece5fcf3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:51.538874 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-12ad037b-95fa-4c17-b479-ad4fece5fcf3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:51.674276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-12ad037b-95fa-4c17-b479-ad4fece5fcf3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:51.681839 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-12ad037b-95fa-4c17-b479-ad4fece5fcf3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1679 microversion: 2.1 time: 0.157757 Aug 24 16:52:51.683098 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 498/990] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:51 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:52:52.706342 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-5d3d7f61-89dc-4ef3-add4-e735e6985a36 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:52.706742 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-5d3d7f61-89dc-4ef3-add4-e735e6985a36 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:52.712727 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d3d7f61-89dc-4ef3-add4-e735e6985a36 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:52.713204 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d3d7f61-89dc-4ef3-add4-e735e6985a36 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:52.714234 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d3d7f61-89dc-4ef3-add4-e735e6985a36 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:52.715079 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d3d7f61-89dc-4ef3-add4-e735e6985a36 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:52.715532 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d3d7f61-89dc-4ef3-add4-e735e6985a36 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:52.715968 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-5d3d7f61-89dc-4ef3-add4-e735e6985a36 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:52.846913 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-5d3d7f61-89dc-4ef3-add4-e735e6985a36 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:52.855208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-5d3d7f61-89dc-4ef3-add4-e735e6985a36 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1679 microversion: 2.1 time: 0.153369 Aug 24 16:52:52.855771 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 493/991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:52 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:53.877129 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-d58b38d3-c965-4258-9ad2-d2a57367dffd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:53.877675 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-d58b38d3-c965-4258-9ad2-d2a57367dffd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:53.883966 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d58b38d3-c965-4258-9ad2-d2a57367dffd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:53.884468 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d58b38d3-c965-4258-9ad2-d2a57367dffd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:53.884901 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d58b38d3-c965-4258-9ad2-d2a57367dffd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:53.885601 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d58b38d3-c965-4258-9ad2-d2a57367dffd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:53.886627 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d58b38d3-c965-4258-9ad2-d2a57367dffd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:53.887062 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-d58b38d3-c965-4258-9ad2-d2a57367dffd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:53.953086 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-d58b38d3-c965-4258-9ad2-d2a57367dffd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:53.960971 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-d58b38d3-c965-4258-9ad2-d2a57367dffd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 200 len: 1612 microversion: 2.1 time: 0.087803 Aug 24 16:52:53.961826 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 499/992] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:53 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 1612 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:54.056724 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-fefeaa86-0cab-4053-85e7-17b0eed59c11 req-20031d9c-d51d-40c3-a1b1-2117927bb785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89e22b2-b09c-48ff-9378-fba95e34a7ee", "name": "network-vif-deleted", "tag": "6348cd60-5f11-4c78-8392-0bcbff6335ed"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:54.067664 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-fefeaa86-0cab-4053-85e7-17b0eed59c11 req-20031d9c-d51d-40c3-a1b1-2117927bb785 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:54.068202 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-fefeaa86-0cab-4053-85e7-17b0eed59c11 req-20031d9c-d51d-40c3-a1b1-2117927bb785 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:54.068639 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-fefeaa86-0cab-4053-85e7-17b0eed59c11 req-20031d9c-d51d-40c3-a1b1-2117927bb785 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:54.080137 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-fefeaa86-0cab-4053-85e7-17b0eed59c11 req-20031d9c-d51d-40c3-a1b1-2117927bb785 service nova] Creating event network-vif-deleted:6348cd60-5f11-4c78-8392-0bcbff6335ed for instance b89e22b2-b09c-48ff-9378-fba95e34a7ee on hv-cinder-77957 Aug 24 16:52:54.086220 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-fefeaa86-0cab-4053-85e7-17b0eed59c11 req-20031d9c-d51d-40c3-a1b1-2117927bb785 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033199 Aug 24 16:52:54.087214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 494/993] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:54.983253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:54.984177 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:54.990863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:54.991437 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:54.991968 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:54.992769 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:54.993294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:54.993790 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:55.011093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee HTTP/1.1 Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:52:55.012786 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:52:55.014677 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'b89e22b2-b09c-48ff-9378-fba95e34a7ee'} Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:52:55.015528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:52:55.016905 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:52:55.018223 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:52:55.018223 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2e156b6c-f5fe-4402-af29-1159b8a41f74 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 404 len: 111 microversion: 2.1 time: 0.035596 Aug 24 16:52:55.018223 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 500/994] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:54 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:52:55.024067 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-587fde8e-5a69-48ad-b579-6b78cb7076b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '.version_select at 0x7f063a842ee0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:55.047864 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-587fde8e-5a69-48ad-b579-6b78cb7076b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-949815170" status: 202 len: 0 microversion: 2.1 time: 0.027933 Aug 24 16:52:55.049212 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 495/995] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Aug 24 16:52:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-949815170 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:52:55.670834 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-7882dcc7-a969-412a-8720-22d4df265af0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: .version_select at 0x7f063abe8dc0>, body: {"keypair": {"name": "tempest-keypair-2081758371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlRt7W3sRhuc5vn5SzDSjEBt2sn1fhuhiukBdUYh4fGMYanHbOHn9HB38E81Wr343Yx5ZONcFe6LPSiUaL1Oi2vEpGQG5rccKZUyNKEnqClNU9MrM99ptPhY+MmYzZtpg=="}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:55.686049 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-7882dcc7-a969-412a-8720-22d4df265af0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:52:55.690175 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-7882dcc7-a969-412a-8720-22d4df265af0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for user 0de20b3d10414699bec5a6eaf15f1aa3 and project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'key_pairs'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:52:55.711563 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-7882dcc7-a969-412a-8720-22d4df265af0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045322 Aug 24 16:52:55.712183 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 501/996] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 16:52:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:52:57.203234 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-110532865", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea37bb26-b217-49f5-97d7-1c427cd1945c"}], "security_groups": [{"name": "tempest-securitygroup--1066494879"}], "key_name": "tempest-keypair-2081758371", "user_data": "}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:52:57.308640 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.network.neutron [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] validate_networks() for [('ea37bb26-b217-49f5-97d7-1c427cd1945c', None, None, None, None, None)] {{(pid=127165) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:52:57.690328 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Flavor limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:52:57.690750 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Image limits 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:52:57.691255 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Flavor pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:52:57.691662 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Image pref 0:0:0 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:52:57.692098 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.virt.hardware [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:52:57.701169 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.701648 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.702078 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.702796 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:57.703249 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:57.703668 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:57.720970 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:52:57.724850 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for user 0de20b3d10414699bec5a6eaf15f1aa3 and project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'instances', 'ram', 'cores'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:52:57.735550 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Going to run 1 instances... {{(pid=127165) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:52:57.738015 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127165) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:52:57.786418 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-fe9d4a7f-0632-43a3-9e6e-3e8a8a65d5c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.588316 Aug 24 16:52:57.787088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 496/997] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:52:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:52:57.798424 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c65406fc-8a8c-4bfa-8f2a-f1a12af8f61d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:57.799035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c65406fc-8a8c-4bfa-8f2a-f1a12af8f61d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:57.853894 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c65406fc-8a8c-4bfa-8f2a-f1a12af8f61d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:57.861290 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c65406fc-8a8c-4bfa-8f2a-f1a12af8f61d tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1241 microversion: 2.1 time: 0.067137 Aug 24 16:52:57.861859 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 502/998] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:57 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:58.882922 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ea98f23e-254f-4d47-8946-c78af34aa658 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:58.883534 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ea98f23e-254f-4d47-8946-c78af34aa658 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:58.889972 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea98f23e-254f-4d47-8946-c78af34aa658 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:58.890458 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea98f23e-254f-4d47-8946-c78af34aa658 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:58.890902 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea98f23e-254f-4d47-8946-c78af34aa658 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:58.891598 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea98f23e-254f-4d47-8946-c78af34aa658 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:58.892081 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea98f23e-254f-4d47-8946-c78af34aa658 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:58.892511 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ea98f23e-254f-4d47-8946-c78af34aa658 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:58.957948 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-ea98f23e-254f-4d47-8946-c78af34aa658 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:52:58.966317 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ea98f23e-254f-4d47-8946-c78af34aa658 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1299 microversion: 2.1 time: 0.087824 Aug 24 16:52:58.966880 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 497/999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:58 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:52:59.987313 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-83da6c12-1a1a-4545-8bcc-61faae1f86c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:52:59.987910 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-83da6c12-1a1a-4545-8bcc-61faae1f86c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:52:59.994407 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-83da6c12-1a1a-4545-8bcc-61faae1f86c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:59.995494 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-83da6c12-1a1a-4545-8bcc-61faae1f86c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:59.995964 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-83da6c12-1a1a-4545-8bcc-61faae1f86c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:52:59.996697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-83da6c12-1a1a-4545-8bcc-61faae1f86c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:52:59.997156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-83da6c12-1a1a-4545-8bcc-61faae1f86c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:52:59.997966 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-83da6c12-1a1a-4545-8bcc-61faae1f86c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:00.133294 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-83da6c12-1a1a-4545-8bcc-61faae1f86c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:00.141366 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-83da6c12-1a1a-4545-8bcc-61faae1f86c3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1367 microversion: 2.1 time: 0.158107 Aug 24 16:53:00.141953 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 503/1000] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:52:59 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:00.271325 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-46a527cd-2859-44d6-a6f5-40486eae1c26 req-b0f95ff0-9e99-4ed6-adb3-f7ab047f735e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317ed219-9de0-434f-9325-dc2b2af77b5e", "tag": "a27af0ff-97ba-4d95-8032-83d54b1202f7"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:00.282959 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-46a527cd-2859-44d6-a6f5-40486eae1c26 req-b0f95ff0-9e99-4ed6-adb3-f7ab047f735e service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:00.283450 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-46a527cd-2859-44d6-a6f5-40486eae1c26 req-b0f95ff0-9e99-4ed6-adb3-f7ab047f735e service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:00.283884 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-46a527cd-2859-44d6-a6f5-40486eae1c26 req-b0f95ff0-9e99-4ed6-adb3-f7ab047f735e service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:00.306666 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-46a527cd-2859-44d6-a6f5-40486eae1c26 req-b0f95ff0-9e99-4ed6-adb3-f7ab047f735e service nova] Creating event network-changed:a27af0ff-97ba-4d95-8032-83d54b1202f7 for instance 317ed219-9de0-434f-9325-dc2b2af77b5e on hv-cinder-77957 Aug 24 16:53:00.311857 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-46a527cd-2859-44d6-a6f5-40486eae1c26 req-b0f95ff0-9e99-4ed6-adb3-f7ab047f735e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044285 Aug 24 16:53:00.312513 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 498/1001] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:01.162775 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5905ea2c-fb5d-4b97-8fe3-749fc7c0b4b8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:01.163407 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5905ea2c-fb5d-4b97-8fe3-749fc7c0b4b8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:01.170384 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5905ea2c-fb5d-4b97-8fe3-749fc7c0b4b8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:01.170862 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5905ea2c-fb5d-4b97-8fe3-749fc7c0b4b8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:01.171292 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5905ea2c-fb5d-4b97-8fe3-749fc7c0b4b8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:01.172202 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5905ea2c-fb5d-4b97-8fe3-749fc7c0b4b8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:01.172653 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5905ea2c-fb5d-4b97-8fe3-749fc7c0b4b8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:01.173071 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5905ea2c-fb5d-4b97-8fe3-749fc7c0b4b8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:01.300774 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-5905ea2c-fb5d-4b97-8fe3-749fc7c0b4b8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:01.309258 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5905ea2c-fb5d-4b97-8fe3-749fc7c0b4b8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1367 microversion: 2.1 time: 0.150347 Aug 24 16:53:01.309820 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 504/1002] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:01 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:02.331274 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-c7e475db-c3ac-426d-906d-b54db1f3008e tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:02.332011 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-c7e475db-c3ac-426d-906d-b54db1f3008e tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:02.338067 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7e475db-c3ac-426d-906d-b54db1f3008e tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:02.338589 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7e475db-c3ac-426d-906d-b54db1f3008e tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:02.339505 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7e475db-c3ac-426d-906d-b54db1f3008e tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:02.340215 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7e475db-c3ac-426d-906d-b54db1f3008e tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:02.340671 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7e475db-c3ac-426d-906d-b54db1f3008e tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:02.341093 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-c7e475db-c3ac-426d-906d-b54db1f3008e tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:02.472574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-c7e475db-c3ac-426d-906d-b54db1f3008e tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:02.480235 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-c7e475db-c3ac-426d-906d-b54db1f3008e tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1367 microversion: 2.1 time: 0.153598 Aug 24 16:53:02.480795 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 499/1003] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:02 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:03.501095 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-4c87d123-2a09-4b3a-acd5-04513f7542a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:03.501697 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-4c87d123-2a09-4b3a-acd5-04513f7542a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:03.508098 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c87d123-2a09-4b3a-acd5-04513f7542a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:03.508584 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c87d123-2a09-4b3a-acd5-04513f7542a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:03.509015 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c87d123-2a09-4b3a-acd5-04513f7542a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:03.509704 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c87d123-2a09-4b3a-acd5-04513f7542a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:03.510156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c87d123-2a09-4b3a-acd5-04513f7542a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:03.510576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-4c87d123-2a09-4b3a-acd5-04513f7542a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:03.638978 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-4c87d123-2a09-4b3a-acd5-04513f7542a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:03.646964 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-4c87d123-2a09-4b3a-acd5-04513f7542a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1367 microversion: 2.1 time: 0.149773 Aug 24 16:53:03.647531 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 505/1004] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:03 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:53:04.670226 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e32ebe92-59b0-4e41-87a3-a75d5f0f9bb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:04.671327 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e32ebe92-59b0-4e41-87a3-a75d5f0f9bb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:04.678517 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e32ebe92-59b0-4e41-87a3-a75d5f0f9bb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:04.679308 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e32ebe92-59b0-4e41-87a3-a75d5f0f9bb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:04.680156 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e32ebe92-59b0-4e41-87a3-a75d5f0f9bb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:04.681427 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e32ebe92-59b0-4e41-87a3-a75d5f0f9bb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:04.682157 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e32ebe92-59b0-4e41-87a3-a75d5f0f9bb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:04.682619 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e32ebe92-59b0-4e41-87a3-a75d5f0f9bb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:04.814074 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-31a014a3-3093-4367-a01b-d265e77f9ce2 req-13eed3d0-b151-4487-b0c7-220a3b7440d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317ed219-9de0-434f-9325-dc2b2af77b5e", "name": "network-vif-plugged", "status": "completed", "tag": "a27af0ff-97ba-4d95-8032-83d54b1202f7"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:04.824028 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-31a014a3-3093-4367-a01b-d265e77f9ce2 req-13eed3d0-b151-4487-b0c7-220a3b7440d5 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:04.824523 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-31a014a3-3093-4367-a01b-d265e77f9ce2 req-13eed3d0-b151-4487-b0c7-220a3b7440d5 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:04.825200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-31a014a3-3093-4367-a01b-d265e77f9ce2 req-13eed3d0-b151-4487-b0c7-220a3b7440d5 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:04.837050 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-31a014a3-3093-4367-a01b-d265e77f9ce2 req-13eed3d0-b151-4487-b0c7-220a3b7440d5 service nova] Creating event network-vif-plugged:a27af0ff-97ba-4d95-8032-83d54b1202f7 for instance 317ed219-9de0-434f-9325-dc2b2af77b5e on hv-cinder-77957 Aug 24 16:53:04.841787 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e32ebe92-59b0-4e41-87a3-a75d5f0f9bb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:04.843213 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-31a014a3-3093-4367-a01b-d265e77f9ce2 req-13eed3d0-b151-4487-b0c7-220a3b7440d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032691 Aug 24 16:53:04.843806 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 506/1005] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:53:04.848914 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e32ebe92-59b0-4e41-87a3-a75d5f0f9bb8 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1367 microversion: 2.1 time: 0.183550 Aug 24 16:53:04.849468 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 500/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:04 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:05.871791 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b6b19f21-cb2b-4d8e-afd7-501f93ef1f15 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:05.872561 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b6b19f21-cb2b-4d8e-afd7-501f93ef1f15 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:05.878660 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b6b19f21-cb2b-4d8e-afd7-501f93ef1f15 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:05.879138 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b6b19f21-cb2b-4d8e-afd7-501f93ef1f15 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:05.879568 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b6b19f21-cb2b-4d8e-afd7-501f93ef1f15 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:05.880278 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b6b19f21-cb2b-4d8e-afd7-501f93ef1f15 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:05.880733 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b6b19f21-cb2b-4d8e-afd7-501f93ef1f15 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:05.881147 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b6b19f21-cb2b-4d8e-afd7-501f93ef1f15 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:06.013068 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b6b19f21-cb2b-4d8e-afd7-501f93ef1f15 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:06.020964 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b6b19f21-cb2b-4d8e-afd7-501f93ef1f15 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1367 microversion: 2.1 time: 0.154112 Aug 24 16:53:06.021528 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 507/1007] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:05 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:07.041381 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-d67e1aae-4324-430d-8b4e-ae028e8da745 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:07.041987 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-d67e1aae-4324-430d-8b4e-ae028e8da745 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:07.048926 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d67e1aae-4324-430d-8b4e-ae028e8da745 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:07.049399 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d67e1aae-4324-430d-8b4e-ae028e8da745 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:07.049822 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d67e1aae-4324-430d-8b4e-ae028e8da745 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:07.050501 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d67e1aae-4324-430d-8b4e-ae028e8da745 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:07.050946 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d67e1aae-4324-430d-8b4e-ae028e8da745 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:07.051358 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-d67e1aae-4324-430d-8b4e-ae028e8da745 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:07.179660 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-d67e1aae-4324-430d-8b4e-ae028e8da745 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:07.187323 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-d67e1aae-4324-430d-8b4e-ae028e8da745 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1557 microversion: 2.1 time: 0.149849 Aug 24 16:53:07.187892 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 501/1008] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:07 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:07.208208 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-1aca96af-d597-418e-bd4a-15bfa4811751 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:07.208843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-1aca96af-d597-418e-bd4a-15bfa4811751 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:07.215106 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1aca96af-d597-418e-bd4a-15bfa4811751 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:07.216735 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1aca96af-d597-418e-bd4a-15bfa4811751 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:07.217174 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1aca96af-d597-418e-bd4a-15bfa4811751 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:07.217870 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1aca96af-d597-418e-bd4a-15bfa4811751 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:07.218328 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1aca96af-d597-418e-bd4a-15bfa4811751 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:07.218784 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-1aca96af-d597-418e-bd4a-15bfa4811751 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:07.299003 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-1aca96af-d597-418e-bd4a-15bfa4811751 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094601 Aug 24 16:53:07.299624 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 508/1009] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 16:53:07 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:08.205810 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-148ebfd8-f040-4aea-b51e-f77e9f02f4c6 req-632e5577-fbb4-46a7-923d-3cbacc23b38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317ed219-9de0-434f-9325-dc2b2af77b5e", "tag": "a27af0ff-97ba-4d95-8032-83d54b1202f7"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:08.210750 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:08.211634 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=6 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:08.219835 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-148ebfd8-f040-4aea-b51e-f77e9f02f4c6 req-632e5577-fbb4-46a7-923d-3cbacc23b38b service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:08.220419 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-148ebfd8-f040-4aea-b51e-f77e9f02f4c6 req-632e5577-fbb4-46a7-923d-3cbacc23b38b service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:08.220910 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-148ebfd8-f040-4aea-b51e-f77e9f02f4c6 req-632e5577-fbb4-46a7-923d-3cbacc23b38b service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:08.232593 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-148ebfd8-f040-4aea-b51e-f77e9f02f4c6 req-632e5577-fbb4-46a7-923d-3cbacc23b38b service nova] Creating event network-changed:a27af0ff-97ba-4d95-8032-83d54b1202f7 for instance 317ed219-9de0-434f-9325-dc2b2af77b5e on hv-cinder-77957 Aug 24 16:53:08.237744 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-148ebfd8-f040-4aea-b51e-f77e9f02f4c6 req-632e5577-fbb4-46a7-923d-3cbacc23b38b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035563 Aug 24 16:53:08.238360 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 502/1010] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:45.233543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=6 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:45.235032 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:45.235761 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:45.240334 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c7f7bea3-385d-4069-8884-95440ca271f4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:45.240832 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c7f7bea3-385d-4069-8884-95440ca271f4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:45.248629 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7f7bea3-385d-4069-8884-95440ca271f4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:45.249657 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7f7bea3-385d-4069-8884-95440ca271f4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:45.249883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7f7bea3-385d-4069-8884-95440ca271f4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:45.250577 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7f7bea3-385d-4069-8884-95440ca271f4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:45.251039 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7f7bea3-385d-4069-8884-95440ca271f4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:45.251473 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7f7bea3-385d-4069-8884-95440ca271f4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:45.275539 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c7f7bea3-385d-4069-8884-95440ca271f4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/ips" status: 200 len: 150 microversion: 2.1 time: 0.043416 Aug 24 16:53:45.276153 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 509/1011] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 16:53:45 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:46.631250 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:46.632121 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:53:46.636697 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b0188be7-92df-4ac5-b192-3b47e38bbf33 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "262245f2-064d-4461-8c0c-f424a4ce5561"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:46.640047 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b0188be7-92df-4ac5-b192-3b47e38bbf33 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:46.647870 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0188be7-92df-4ac5-b192-3b47e38bbf33 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:46.648424 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0188be7-92df-4ac5-b192-3b47e38bbf33 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:46.648937 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0188be7-92df-4ac5-b192-3b47e38bbf33 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:46.649742 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0188be7-92df-4ac5-b192-3b47e38bbf33 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:46.650197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0188be7-92df-4ac5-b192-3b47e38bbf33 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:46.650621 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b0188be7-92df-4ac5-b192-3b47e38bbf33 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:46.916938 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b0188be7-92df-4ac5-b192-3b47e38bbf33 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286529 Aug 24 16:53:46.917561 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 503/1012] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:53:46 2022] POST /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:53.393830 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "262245f2-064d-4461-8c0c-f424a4ce5561"}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:53.396263 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:53.402296 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:53.402772 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:53.403200 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:53.404466 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:53.404918 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:53.405333 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:53.485880 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Invalid volume: volume 262245f2-064d-4461-8c0c-f424a4ce5561 is already attached to instances: 317ed219-9de0-434f-9325-dc2b2af77b5e Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: POST /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments HTTP/1.1 Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 74 Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:53:53.487695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {"volumeAttachment": {"volumeId": "262245f2-064d-4461-8c0c-f424a4ce5561"}} Aug 24 16:53:53.489430 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Invalid volume: volume 262245f2-064d-4461-8c0c-f424a4ce5561 is already attached to instances: 317ed219-9de0-434f-9325-dc2b2af77b5e Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'server_id': '317ed219-9de0-434f-9325-dc2b2af77b5e', 'body': {'volumeAttachment': {'volumeId': '262245f2-064d-4461-8c0c-f424a4ce5561'}}} Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 262245f2-064d-4461-8c0c-f424a4ce5561 is already attached to instances: 317ed219-9de0-434f-9325-dc2b2af77b5e Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:53:53.490445 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 262245f2-064d-4461-8c0c-f424a4ce5561 is already attached to instances: 317ed219-9de0-434f-9325-dc2b2af77b5e Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:53.492146 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:53:53.493943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:53:53.493943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:53:53.493943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:53:53.493943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 262245f2-064d-4461-8c0c-f424a4ce5561 is already attached to instances: 317ed219-9de0-434f-9325-dc2b2af77b5e Aug 24 16:53:53.493943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:53:53.493943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 400 to user: Invalid volume: volume 262245f2-064d-4461-8c0c-f424a4ce5561 is already attached to instances: 317ed219-9de0-434f-9325-dc2b2af77b5e {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:53:53.493943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-da1aebcc-d293-4444-8a35-6f7a20c6f661 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099685 Aug 24 16:53:53.493943 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 510/1013] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:53:53 2022] POST /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 16:53:53.555361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ec33a4e7-0287-4552-847f-cf67372119ef tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:53.556014 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ec33a4e7-0287-4552-847f-cf67372119ef tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:53.563345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec33a4e7-0287-4552-847f-cf67372119ef tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:53.563834 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec33a4e7-0287-4552-847f-cf67372119ef tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:53.564299 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec33a4e7-0287-4552-847f-cf67372119ef tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:53.565036 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec33a4e7-0287-4552-847f-cf67372119ef tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:53.565554 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec33a4e7-0287-4552-847f-cf67372119ef tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:53.566061 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ec33a4e7-0287-4552-847f-cf67372119ef tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:53.650578 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.objects.instance [None req-ec33a4e7-0287-4552-847f-cf67372119ef tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lazy-loading 'services' on Instance uuid 317ed219-9de0-434f-9325-dc2b2af77b5e {{(pid=127165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:53:53.721430 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ec33a4e7-0287-4552-847f-cf67372119ef tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments/262245f2-064d-4461-8c0c-f424a4ce5561" status: 202 len: 0 microversion: 2.1 time: 0.170222 Aug 24 16:53:53.722022 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 504/1014] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:53:53 2022] DELETE /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments/262245f2-064d-4461-8c0c-f424a4ce5561 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:53:53.730299 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-5f2965f9-e2e8-46ec-aaf6-507539ab456a tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:53.732465 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-5f2965f9-e2e8-46ec-aaf6-507539ab456a tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:53.739064 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f2965f9-e2e8-46ec-aaf6-507539ab456a tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:53.739550 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f2965f9-e2e8-46ec-aaf6-507539ab456a tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:53.740246 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f2965f9-e2e8-46ec-aaf6-507539ab456a tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:53.740956 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f2965f9-e2e8-46ec-aaf6-507539ab456a tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:53.741418 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f2965f9-e2e8-46ec-aaf6-507539ab456a tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:53.741930 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-5f2965f9-e2e8-46ec-aaf6-507539ab456a tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:53.774824 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-5f2965f9-e2e8-46ec-aaf6-507539ab456a tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048372 Aug 24 16:53:53.776314 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 511/1015] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:53:53 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:54.787979 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-595aea15-16b5-4e52-8b01-11a7d2035370 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:54.790229 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-595aea15-16b5-4e52-8b01-11a7d2035370 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:54.797319 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-595aea15-16b5-4e52-8b01-11a7d2035370 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:54.797799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-595aea15-16b5-4e52-8b01-11a7d2035370 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:54.798230 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-595aea15-16b5-4e52-8b01-11a7d2035370 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:54.798912 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-595aea15-16b5-4e52-8b01-11a7d2035370 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:54.799363 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-595aea15-16b5-4e52-8b01-11a7d2035370 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:54.799781 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-595aea15-16b5-4e52-8b01-11a7d2035370 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:54.829887 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-595aea15-16b5-4e52-8b01-11a7d2035370 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046328 Aug 24 16:53:54.830729 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 505/1016] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:53:54 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:53:54.893096 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e9f2b09b-36c1-424c-8873-043bc7ad89a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:54.893632 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e9f2b09b-36c1-424c-8873-043bc7ad89a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:54.899970 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f2b09b-36c1-424c-8873-043bc7ad89a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:54.900477 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f2b09b-36c1-424c-8873-043bc7ad89a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:54.900914 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f2b09b-36c1-424c-8873-043bc7ad89a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:54.901608 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f2b09b-36c1-424c-8873-043bc7ad89a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:54.902063 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f2b09b-36c1-424c-8873-043bc7ad89a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:54.902486 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e9f2b09b-36c1-424c-8873-043bc7ad89a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:54.926509 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e9f2b09b-36c1-424c-8873-043bc7ad89a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Going to try to terminate instance {{(pid=127166) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:53:55.006956 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e9f2b09b-36c1-424c-8873-043bc7ad89a3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 204 len: 0 microversion: 2.1 time: 0.118465 Aug 24 16:53:55.007680 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 512/1017] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:53:54 2022] DELETE /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:53:55.016993 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-8c6bbdec-d4d1-430d-82e7-560b7c70e118 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:55.017671 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-8c6bbdec-d4d1-430d-82e7-560b7c70e118 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:55.023574 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c6bbdec-d4d1-430d-82e7-560b7c70e118 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:55.024091 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c6bbdec-d4d1-430d-82e7-560b7c70e118 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:55.024527 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c6bbdec-d4d1-430d-82e7-560b7c70e118 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:55.025214 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c6bbdec-d4d1-430d-82e7-560b7c70e118 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:55.025664 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c6bbdec-d4d1-430d-82e7-560b7c70e118 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:55.026082 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-8c6bbdec-d4d1-430d-82e7-560b7c70e118 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:55.158818 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-8c6bbdec-d4d1-430d-82e7-560b7c70e118 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:55.166425 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-8c6bbdec-d4d1-430d-82e7-560b7c70e118 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1682 microversion: 2.1 time: 0.154575 Aug 24 16:53:55.166996 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 506/1018] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:55 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:56.188939 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-618ddc2e-70a0-4a5a-8dcc-417c5be65324 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:56.189642 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-618ddc2e-70a0-4a5a-8dcc-417c5be65324 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:56.196118 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-618ddc2e-70a0-4a5a-8dcc-417c5be65324 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:56.196598 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-618ddc2e-70a0-4a5a-8dcc-417c5be65324 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:56.197026 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-618ddc2e-70a0-4a5a-8dcc-417c5be65324 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:56.197712 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-618ddc2e-70a0-4a5a-8dcc-417c5be65324 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:56.198158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-618ddc2e-70a0-4a5a-8dcc-417c5be65324 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:56.198582 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-618ddc2e-70a0-4a5a-8dcc-417c5be65324 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:56.328089 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-618ddc2e-70a0-4a5a-8dcc-417c5be65324 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:56.335824 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-618ddc2e-70a0-4a5a-8dcc-417c5be65324 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1682 microversion: 2.1 time: 0.152202 Aug 24 16:53:56.336439 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 513/1019] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:56 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:57.357191 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-57c97f0c-b849-412a-81ee-0e9ef82d2323 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:57.357906 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-57c97f0c-b849-412a-81ee-0e9ef82d2323 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:57.366633 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-57c97f0c-b849-412a-81ee-0e9ef82d2323 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:57.367127 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-57c97f0c-b849-412a-81ee-0e9ef82d2323 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:57.367559 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-57c97f0c-b849-412a-81ee-0e9ef82d2323 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:57.368287 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-57c97f0c-b849-412a-81ee-0e9ef82d2323 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:57.368741 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-57c97f0c-b849-412a-81ee-0e9ef82d2323 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:57.369189 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-57c97f0c-b849-412a-81ee-0e9ef82d2323 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:57.432814 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-57c97f0c-b849-412a-81ee-0e9ef82d2323 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:53:57.440997 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-57c97f0c-b849-412a-81ee-0e9ef82d2323 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 200 len: 1614 microversion: 2.1 time: 0.087630 Aug 24 16:53:57.441599 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 507/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:57 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:53:57.530668 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-4aa810eb-4ae5-497f-8ccf-b6dbfe2c6d1d req-e89d522f-eb6b-419b-a721-4e817a79db07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317ed219-9de0-434f-9325-dc2b2af77b5e", "name": "network-vif-deleted", "tag": "a27af0ff-97ba-4d95-8032-83d54b1202f7"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:57.540778 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-4aa810eb-4ae5-497f-8ccf-b6dbfe2c6d1d req-e89d522f-eb6b-419b-a721-4e817a79db07 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:57.541269 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-4aa810eb-4ae5-497f-8ccf-b6dbfe2c6d1d req-e89d522f-eb6b-419b-a721-4e817a79db07 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:57.541707 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-4aa810eb-4ae5-497f-8ccf-b6dbfe2c6d1d req-e89d522f-eb6b-419b-a721-4e817a79db07 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:57.554221 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-4aa810eb-4ae5-497f-8ccf-b6dbfe2c6d1d req-e89d522f-eb6b-419b-a721-4e817a79db07 service nova] Creating event network-vif-deleted:a27af0ff-97ba-4d95-8032-83d54b1202f7 for instance 317ed219-9de0-434f-9325-dc2b2af77b5e on hv-cinder-77957 Aug 24 16:53:57.559845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-4aa810eb-4ae5-497f-8ccf-b6dbfe2c6d1d req-e89d522f-eb6b-419b-a721-4e817a79db07 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032737 Aug 24 16:53:57.560490 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 514/1021] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:53:58.462809 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:58.463493 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:53:58.471435 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:58.472033 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:58.472464 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:58.473167 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:53:58.473615 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:53:58.474041 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:53:58.488847 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e HTTP/1.1 Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:53:58.490515 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:53:58.492306 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '317ed219-9de0-434f-9325-dc2b2af77b5e'} Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:53:58.493251 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:53:58.494837 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:53:58.496326 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:53:58.496326 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1409ec38-6ae0-4547-9aaf-9c09071214f0 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 404 len: 111 microversion: 2.1 time: 0.033202 Aug 24 16:53:58.496326 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 508/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:53:58 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:53:58.502527 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-13a953ef-169e-4526-bfe9-1022a2cdc7b1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '.version_select at 0x7f063aa02700>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:53:58.521783 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-13a953ef-169e-4526-bfe9-1022a2cdc7b1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081758371" status: 202 len: 0 microversion: 2.1 time: 0.024010 Aug 24 16:53:58.522382 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 515/1023] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 24 16:53:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081758371 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:53:59.160969 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-415ebf28-5d53-417e-b98d-93645f40fabf tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: .version_select at 0x7f063af75c10>, body: {"keypair": {"name": "tempest-keypair-771505865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOFNqHQZu5Byr/A+Z6QPSZdqPVvCjb4bfRuRU1Fo0528Hrf2o9k0SeMTHG9I8tjV6D/hIg24tosdl+YLMqRS0eWOZj9BJovOFSP3fSmPHC9LN1jQv6Y6cc+4mgPwnxxsA=="}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:53:59.177037 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-415ebf28-5d53-417e-b98d-93645f40fabf tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:53:59.180754 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.quota [None req-415ebf28-5d53-417e-b98d-93645f40fabf tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for user 0de20b3d10414699bec5a6eaf15f1aa3 and project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'key_pairs'} {{(pid=127165) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:53:59.204270 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-415ebf28-5d53-417e-b98d-93645f40fabf tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047213 Aug 24 16:53:59.204876 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 509/1024] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 16:53:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:54:00.409272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1717276364", "imageRef": "dfbf9f52-ae09-4a61-943a-220c4b930bd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea37bb26-b217-49f5-97d7-1c427cd1945c"}], "security_groups": [{"name": "tempest-securitygroup--718574572"}], "key_name": "tempest-keypair-771505865", "user_data": "}} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:00.518691 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.network.neutron [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] validate_networks() for [('ea37bb26-b217-49f5-97d7-1c427cd1945c', None, None, None, None, None)] {{(pid=127166) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 16:54:00.946451 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Flavor limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 16:54:00.946884 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Image limits 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 16:54:00.947365 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Flavor pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 16:54:00.947781 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Image pref 0:0:0 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 16:54:00.948230 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.virt.hardware [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127166) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 16:54:00.957810 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:00.958302 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:00.958745 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:00.959603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:00.960093 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:00.960642 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:00.978046 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 16:54:00.981938 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.quota [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Getting quotas for user 0de20b3d10414699bec5a6eaf15f1aa3 and project eec14f7fdaae43b68bc7113a7f17544b. Resources: {'instances', 'ram', 'cores'} {{(pid=127166) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 16:54:00.993313 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Going to run 1 instances... {{(pid=127166) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 16:54:00.995708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dfbf9f52-ae09-4a61-943a-220c4b930bd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127166) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 16:54:01.045115 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-de92888c-7ebc-4644-be7b-8a8cd77350e9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.640675 Aug 24 16:54:01.045776 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 516/1025] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 16:54:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 16:54:01.057169 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-9e115aef-1cf3-4ee5-940e-a0298e5bcdce tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:01.057944 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-9e115aef-1cf3-4ee5-940e-a0298e5bcdce tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:01.115447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-9e115aef-1cf3-4ee5-940e-a0298e5bcdce tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:01.122204 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-9e115aef-1cf3-4ee5-940e-a0298e5bcdce tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1241 microversion: 2.1 time: 0.068813 Aug 24 16:54:01.122778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 510/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:01 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:02.143669 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a81851e2-3f62-4eb7-b816-dbc2262396b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:02.144313 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a81851e2-3f62-4eb7-b816-dbc2262396b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:02.152077 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a81851e2-3f62-4eb7-b816-dbc2262396b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:02.152557 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a81851e2-3f62-4eb7-b816-dbc2262396b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:02.152988 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a81851e2-3f62-4eb7-b816-dbc2262396b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:02.153676 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a81851e2-3f62-4eb7-b816-dbc2262396b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:02.154125 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a81851e2-3f62-4eb7-b816-dbc2262396b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:02.154543 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a81851e2-3f62-4eb7-b816-dbc2262396b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:02.220912 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-a81851e2-3f62-4eb7-b816-dbc2262396b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:02.228790 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a81851e2-3f62-4eb7-b816-dbc2262396b3 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1299 microversion: 2.1 time: 0.089912 Aug 24 16:54:02.229346 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 517/1027] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:02 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:03.250906 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-4f2177ac-ec35-4575-a043-492d4ace3bb2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:03.251627 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-4f2177ac-ec35-4575-a043-492d4ace3bb2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:03.257955 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4f2177ac-ec35-4575-a043-492d4ace3bb2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:03.258447 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4f2177ac-ec35-4575-a043-492d4ace3bb2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:03.258883 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4f2177ac-ec35-4575-a043-492d4ace3bb2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:03.259584 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4f2177ac-ec35-4575-a043-492d4ace3bb2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:03.260071 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4f2177ac-ec35-4575-a043-492d4ace3bb2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:03.260499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-4f2177ac-ec35-4575-a043-492d4ace3bb2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:03.394581 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-4f2177ac-ec35-4575-a043-492d4ace3bb2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:03.402260 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-4f2177ac-ec35-4575-a043-492d4ace3bb2 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1366 microversion: 2.1 time: 0.156013 Aug 24 16:54:03.402827 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 511/1028] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:03 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:03.439637 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-c020a59a-5ab2-4fb1-97ee-d38e7787b44e req-5087e090-2d7b-4c6d-8c32-277e76561b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42162a14-0745-4bae-8b2d-e049780948b6", "tag": "aa982ba3-1613-4461-a621-81884a5f9f0f"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:03.450816 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c020a59a-5ab2-4fb1-97ee-d38e7787b44e req-5087e090-2d7b-4c6d-8c32-277e76561b5d service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:03.451345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c020a59a-5ab2-4fb1-97ee-d38e7787b44e req-5087e090-2d7b-4c6d-8c32-277e76561b5d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:03.451845 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-c020a59a-5ab2-4fb1-97ee-d38e7787b44e req-5087e090-2d7b-4c6d-8c32-277e76561b5d service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:03.464210 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-c020a59a-5ab2-4fb1-97ee-d38e7787b44e req-5087e090-2d7b-4c6d-8c32-277e76561b5d service nova] Creating event network-changed:aa982ba3-1613-4461-a621-81884a5f9f0f for instance 42162a14-0745-4bae-8b2d-e049780948b6 on hv-cinder-77957 Aug 24 16:54:03.469362 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-c020a59a-5ab2-4fb1-97ee-d38e7787b44e req-5087e090-2d7b-4c6d-8c32-277e76561b5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033956 Aug 24 16:54:03.470050 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 518/1029] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:04.423455 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-3bff7c51-7990-4b76-9ba7-67c6392cd15b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:04.424103 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-3bff7c51-7990-4b76-9ba7-67c6392cd15b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:04.430526 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3bff7c51-7990-4b76-9ba7-67c6392cd15b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:04.431012 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3bff7c51-7990-4b76-9ba7-67c6392cd15b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:04.431451 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3bff7c51-7990-4b76-9ba7-67c6392cd15b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:04.432174 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3bff7c51-7990-4b76-9ba7-67c6392cd15b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:04.432633 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3bff7c51-7990-4b76-9ba7-67c6392cd15b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:04.433058 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-3bff7c51-7990-4b76-9ba7-67c6392cd15b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:04.560182 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-3bff7c51-7990-4b76-9ba7-67c6392cd15b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:04.568614 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-3bff7c51-7990-4b76-9ba7-67c6392cd15b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1366 microversion: 2.1 time: 0.149647 Aug 24 16:54:04.569208 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 512/1030] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:04 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:05.591345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e8e78f18-af1d-43a1-ad01-874f9d70dede tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:05.592076 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e8e78f18-af1d-43a1-ad01-874f9d70dede tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:05.599005 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8e78f18-af1d-43a1-ad01-874f9d70dede tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:05.599488 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8e78f18-af1d-43a1-ad01-874f9d70dede tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:05.599924 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8e78f18-af1d-43a1-ad01-874f9d70dede tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:05.600638 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8e78f18-af1d-43a1-ad01-874f9d70dede tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:05.601092 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8e78f18-af1d-43a1-ad01-874f9d70dede tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:05.601514 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e8e78f18-af1d-43a1-ad01-874f9d70dede tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:05.728097 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-e8e78f18-af1d-43a1-ad01-874f9d70dede tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:05.736307 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e8e78f18-af1d-43a1-ad01-874f9d70dede tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1366 microversion: 2.1 time: 0.149736 Aug 24 16:54:05.736881 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 519/1031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:05 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:06.757201 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-35c572b6-2a02-42e2-99dc-8e6911bd61d1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:06.757747 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-35c572b6-2a02-42e2-99dc-8e6911bd61d1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:06.764162 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35c572b6-2a02-42e2-99dc-8e6911bd61d1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:06.764897 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35c572b6-2a02-42e2-99dc-8e6911bd61d1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:06.765872 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35c572b6-2a02-42e2-99dc-8e6911bd61d1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:06.766564 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35c572b6-2a02-42e2-99dc-8e6911bd61d1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:06.767020 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35c572b6-2a02-42e2-99dc-8e6911bd61d1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:06.767442 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-35c572b6-2a02-42e2-99dc-8e6911bd61d1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:06.904385 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-35c572b6-2a02-42e2-99dc-8e6911bd61d1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:06.915977 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-35c572b6-2a02-42e2-99dc-8e6911bd61d1 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1366 microversion: 2.1 time: 0.162478 Aug 24 16:54:06.916830 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 513/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:06 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:54:07.945195 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b790e232-7e3f-4cf8-9c1e-1bf15272732b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:07.945821 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b790e232-7e3f-4cf8-9c1e-1bf15272732b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:07.953039 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b790e232-7e3f-4cf8-9c1e-1bf15272732b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:07.953567 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b790e232-7e3f-4cf8-9c1e-1bf15272732b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:07.954000 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b790e232-7e3f-4cf8-9c1e-1bf15272732b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:07.954695 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b790e232-7e3f-4cf8-9c1e-1bf15272732b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:07.955157 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b790e232-7e3f-4cf8-9c1e-1bf15272732b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:07.955582 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b790e232-7e3f-4cf8-9c1e-1bf15272732b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:08.085092 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-b790e232-7e3f-4cf8-9c1e-1bf15272732b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:08.092595 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b790e232-7e3f-4cf8-9c1e-1bf15272732b tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1366 microversion: 2.1 time: 0.151292 Aug 24 16:54:08.093724 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 520/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:07 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:09.114667 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-1c96cb0b-0292-45c7-b912-a6d106a6f4d5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:09.115269 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-1c96cb0b-0292-45c7-b912-a6d106a6f4d5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:09.121772 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c96cb0b-0292-45c7-b912-a6d106a6f4d5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:09.122240 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c96cb0b-0292-45c7-b912-a6d106a6f4d5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:09.122669 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c96cb0b-0292-45c7-b912-a6d106a6f4d5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:09.123359 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c96cb0b-0292-45c7-b912-a6d106a6f4d5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:09.123807 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c96cb0b-0292-45c7-b912-a6d106a6f4d5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:09.124311 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-1c96cb0b-0292-45c7-b912-a6d106a6f4d5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:09.180040 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [req-a5414aeb-bd10-4036-ae1a-cf8f93a8065a req-36818a5f-8a3c-4871-8760-07e082fcef69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42162a14-0745-4bae-8b2d-e049780948b6", "name": "network-vif-plugged", "status": "completed", "tag": "aa982ba3-1613-4461-a621-81884a5f9f0f"}]} {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:09.191486 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a5414aeb-bd10-4036-ae1a-cf8f93a8065a req-36818a5f-8a3c-4871-8760-07e082fcef69 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:09.191987 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a5414aeb-bd10-4036-ae1a-cf8f93a8065a req-36818a5f-8a3c-4871-8760-07e082fcef69 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:09.192414 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [req-a5414aeb-bd10-4036-ae1a-cf8f93a8065a req-36818a5f-8a3c-4871-8760-07e082fcef69 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:09.204506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.compute.server_external_events [req-a5414aeb-bd10-4036-ae1a-cf8f93a8065a req-36818a5f-8a3c-4871-8760-07e082fcef69 service nova] Creating event network-vif-plugged:aa982ba3-1613-4461-a621-81884a5f9f0f for instance 42162a14-0745-4bae-8b2d-e049780948b6 on hv-cinder-77957 Aug 24 16:54:09.209413 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [req-a5414aeb-bd10-4036-ae1a-cf8f93a8065a req-36818a5f-8a3c-4871-8760-07e082fcef69 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033564 Aug 24 16:54:09.209989 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 521/1034] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 16:54:09.268079 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-1c96cb0b-0292-45c7-b912-a6d106a6f4d5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:09.275974 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-1c96cb0b-0292-45c7-b912-a6d106a6f4d5 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1366 microversion: 2.1 time: 0.165135 Aug 24 16:54:09.276607 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 514/1035] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:09 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:54:10.298847 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-bff7adeb-d200-4ad9-bfdf-a2450c24c105 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:10.299454 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-bff7adeb-d200-4ad9-bfdf-a2450c24c105 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:10.305603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bff7adeb-d200-4ad9-bfdf-a2450c24c105 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:10.306088 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bff7adeb-d200-4ad9-bfdf-a2450c24c105 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:10.306525 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bff7adeb-d200-4ad9-bfdf-a2450c24c105 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:10.307217 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bff7adeb-d200-4ad9-bfdf-a2450c24c105 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:10.307674 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bff7adeb-d200-4ad9-bfdf-a2450c24c105 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:10.308134 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-bff7adeb-d200-4ad9-bfdf-a2450c24c105 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:10.435739 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-bff7adeb-d200-4ad9-bfdf-a2450c24c105 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:10.443841 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-bff7adeb-d200-4ad9-bfdf-a2450c24c105 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1366 microversion: 2.1 time: 0.149912 Aug 24 16:54:10.444436 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 522/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:10 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:11.465223 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-53e4de3f-3454-4947-9e5d-e0fd89d27721 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:11.465830 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-53e4de3f-3454-4947-9e5d-e0fd89d27721 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:11.468825 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell0:SELECT=6 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:11.474765 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53e4de3f-3454-4947-9e5d-e0fd89d27721 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:11.475252 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53e4de3f-3454-4947-9e5d-e0fd89d27721 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:11.475689 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53e4de3f-3454-4947-9e5d-e0fd89d27721 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:11.476409 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53e4de3f-3454-4947-9e5d-e0fd89d27721 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:11.476863 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53e4de3f-3454-4947-9e5d-e0fd89d27721 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:11.477284 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-53e4de3f-3454-4947-9e5d-e0fd89d27721 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:11.608480 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-53e4de3f-3454-4947-9e5d-e0fd89d27721 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:11.616320 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-53e4de3f-3454-4947-9e5d-e0fd89d27721 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1556 microversion: 2.1 time: 0.155012 Aug 24 16:54:11.616881 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 515/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:11 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:54:11.636359 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-f69b4e8f-b2ce-47e3-ada8-ff8415d9cffa tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:11.636873 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-f69b4e8f-b2ce-47e3-ada8-ff8415d9cffa tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:11.638863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=2 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:11.640620 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell0:SELECT=6 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:11.647346 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f69b4e8f-b2ce-47e3-ada8-ff8415d9cffa tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:11.647830 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f69b4e8f-b2ce-47e3-ada8-ff8415d9cffa tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:11.648292 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f69b4e8f-b2ce-47e3-ada8-ff8415d9cffa tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:11.648983 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f69b4e8f-b2ce-47e3-ada8-ff8415d9cffa tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:11.649443 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f69b4e8f-b2ce-47e3-ada8-ff8415d9cffa tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:11.649863 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-f69b4e8f-b2ce-47e3-ada8-ff8415d9cffa tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:11.729994 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-f69b4e8f-b2ce-47e3-ada8-ff8415d9cffa tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097442 Aug 24 16:54:11.730601 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 523/1038] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 16:54:11 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:12.888296 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-580dcc6f-1d6b-4efb-9749-b0ef7aa213a9 req-03e57734-2898-4191-946c-cdc488d0fec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42162a14-0745-4bae-8b2d-e049780948b6", "tag": "aa982ba3-1613-4461-a621-81884a5f9f0f"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:12.899258 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-580dcc6f-1d6b-4efb-9749-b0ef7aa213a9 req-03e57734-2898-4191-946c-cdc488d0fec4 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:12.899857 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-580dcc6f-1d6b-4efb-9749-b0ef7aa213a9 req-03e57734-2898-4191-946c-cdc488d0fec4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:12.900386 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-580dcc6f-1d6b-4efb-9749-b0ef7aa213a9 req-03e57734-2898-4191-946c-cdc488d0fec4 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:12.911737 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-580dcc6f-1d6b-4efb-9749-b0ef7aa213a9 req-03e57734-2898-4191-946c-cdc488d0fec4 service nova] Creating event network-changed:aa982ba3-1613-4461-a621-81884a5f9f0f for instance 42162a14-0745-4bae-8b2d-e049780948b6 on hv-cinder-77957 Aug 24 16:54:12.916775 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-580dcc6f-1d6b-4efb-9749-b0ef7aa213a9 req-03e57734-2898-4191-946c-cdc488d0fec4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032201 Aug 24 16:54:12.917422 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 516/1039] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:48.850174 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:48.851044 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG dbcounter [-] [127166] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127166) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:48.855329 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-40e4000d-1d3c-44dd-ba5b-2ef9cf49f13f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:48.855851 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-40e4000d-1d3c-44dd-ba5b-2ef9cf49f13f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:48.863848 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-40e4000d-1d3c-44dd-ba5b-2ef9cf49f13f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:48.864359 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-40e4000d-1d3c-44dd-ba5b-2ef9cf49f13f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:48.864798 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-40e4000d-1d3c-44dd-ba5b-2ef9cf49f13f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:48.865489 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-40e4000d-1d3c-44dd-ba5b-2ef9cf49f13f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:48.865947 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-40e4000d-1d3c-44dd-ba5b-2ef9cf49f13f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:48.866372 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-40e4000d-1d3c-44dd-ba5b-2ef9cf49f13f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:48.894264 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-40e4000d-1d3c-44dd-ba5b-2ef9cf49f13f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/ips" status: 200 len: 150 microversion: 2.1 time: 0.045385 Aug 24 16:54:48.894820 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 524/1040] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 16:54:48 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:50.216612 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:50.217342 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG dbcounter [-] [127165] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127165) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:50.222095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-aabee206-b9de-47ae-a39a-ff8ffb7a7734 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "129ac199-1b7c-4bde-b50d-51cc54b6fde8"}} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:54:50.224505 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-aabee206-b9de-47ae-a39a-ff8ffb7a7734 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:50.231927 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aabee206-b9de-47ae-a39a-ff8ffb7a7734 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:50.232514 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aabee206-b9de-47ae-a39a-ff8ffb7a7734 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:50.232967 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aabee206-b9de-47ae-a39a-ff8ffb7a7734 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:50.233676 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aabee206-b9de-47ae-a39a-ff8ffb7a7734 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:50.234123 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aabee206-b9de-47ae-a39a-ff8ffb7a7734 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:50.234535 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-aabee206-b9de-47ae-a39a-ff8ffb7a7734 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:50.581562 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-aabee206-b9de-47ae-a39a-ff8ffb7a7734 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "POST /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366512 Aug 24 16:54:50.582102 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 517/1041] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 16:54:50 2022] POST /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:57.165573 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-b3f63d4a-5334-4caf-829c-3200a25c51b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:57.166113 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-b3f63d4a-5334-4caf-829c-3200a25c51b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:57.172441 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b3f63d4a-5334-4caf-829c-3200a25c51b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:57.172929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b3f63d4a-5334-4caf-829c-3200a25c51b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:57.174084 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b3f63d4a-5334-4caf-829c-3200a25c51b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:57.174702 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b3f63d4a-5334-4caf-829c-3200a25c51b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:57.175161 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b3f63d4a-5334-4caf-829c-3200a25c51b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:57.175586 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-b3f63d4a-5334-4caf-829c-3200a25c51b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:57.310972 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.objects.instance [None req-b3f63d4a-5334-4caf-829c-3200a25c51b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lazy-loading 'services' on Instance uuid 42162a14-0745-4bae-8b2d-e049780948b6 {{(pid=127166) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 16:54:57.385754 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-b3f63d4a-5334-4caf-829c-3200a25c51b4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/os-volume_attachments/129ac199-1b7c-4bde-b50d-51cc54b6fde8" status: 202 len: 0 microversion: 2.1 time: 0.223926 Aug 24 16:54:57.386331 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 525/1042] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 16:54:57 2022] DELETE /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/os-volume_attachments/129ac199-1b7c-4bde-b50d-51cc54b6fde8 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:54:57.396778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-fb5b539e-0026-4e91-a936-650517aba67f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:57.399107 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-fb5b539e-0026-4e91-a936-650517aba67f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:57.405203 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb5b539e-0026-4e91-a936-650517aba67f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:57.405686 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb5b539e-0026-4e91-a936-650517aba67f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:57.406109 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb5b539e-0026-4e91-a936-650517aba67f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:57.406801 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb5b539e-0026-4e91-a936-650517aba67f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:57.407244 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb5b539e-0026-4e91-a936-650517aba67f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:57.408392 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-fb5b539e-0026-4e91-a936-650517aba67f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:57.442466 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-fb5b539e-0026-4e91-a936-650517aba67f tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051260 Aug 24 16:54:57.443124 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 518/1043] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:54:57 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:54:58.456637 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-dba4d9b2-18c2-4ebd-8107-31fceaf0c307 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:58.458929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-dba4d9b2-18c2-4ebd-8107-31fceaf0c307 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:58.465322 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dba4d9b2-18c2-4ebd-8107-31fceaf0c307 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:58.465805 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dba4d9b2-18c2-4ebd-8107-31fceaf0c307 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:58.466237 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dba4d9b2-18c2-4ebd-8107-31fceaf0c307 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:58.466934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dba4d9b2-18c2-4ebd-8107-31fceaf0c307 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:58.467387 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dba4d9b2-18c2-4ebd-8107-31fceaf0c307 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:58.467810 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-dba4d9b2-18c2-4ebd-8107-31fceaf0c307 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:58.496155 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-dba4d9b2-18c2-4ebd-8107-31fceaf0c307 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045103 Aug 24 16:54:58.496708 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 526/1044] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 16:54:58 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 16:54:58.557553 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-f43d733b-4c44-4986-a596-c27185709c00 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:58.558064 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f43d733b-4c44-4986-a596-c27185709c00 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:58.565210 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f43d733b-4c44-4986-a596-c27185709c00 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:58.565752 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f43d733b-4c44-4986-a596-c27185709c00 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:58.566125 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f43d733b-4c44-4986-a596-c27185709c00 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:58.566812 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f43d733b-4c44-4986-a596-c27185709c00 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:58.567257 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f43d733b-4c44-4986-a596-c27185709c00 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:58.567671 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-f43d733b-4c44-4986-a596-c27185709c00 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:58.593296 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-f43d733b-4c44-4986-a596-c27185709c00 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Going to try to terminate instance {{(pid=127165) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 16:54:58.667477 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-f43d733b-4c44-4986-a596-c27185709c00 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 204 len: 0 microversion: 2.1 time: 0.113537 Aug 24 16:54:58.668418 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 519/1045] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:54:58 2022] DELETE /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 16:54:58.678629 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-2f649a10-cba1-4f00-95ce-a7c6e3afe548 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:58.679280 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-2f649a10-cba1-4f00-95ce-a7c6e3afe548 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:58.685392 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2f649a10-cba1-4f00-95ce-a7c6e3afe548 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:58.685873 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2f649a10-cba1-4f00-95ce-a7c6e3afe548 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:58.686311 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2f649a10-cba1-4f00-95ce-a7c6e3afe548 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:58.687053 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2f649a10-cba1-4f00-95ce-a7c6e3afe548 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:58.687498 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2f649a10-cba1-4f00-95ce-a7c6e3afe548 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:58.687923 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-2f649a10-cba1-4f00-95ce-a7c6e3afe548 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:58.824327 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-2f649a10-cba1-4f00-95ce-a7c6e3afe548 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:54:58.832157 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-2f649a10-cba1-4f00-95ce-a7c6e3afe548 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1681 microversion: 2.1 time: 0.159671 Aug 24 16:54:58.832729 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 527/1046] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:58 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 16:54:59.854209 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-e5a018e5-3a56-4b4b-8857-d6c55ecd2fb9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:54:59.854913 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-e5a018e5-3a56-4b4b-8857-d6c55ecd2fb9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:54:59.862010 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5a018e5-3a56-4b4b-8857-d6c55ecd2fb9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:59.862499 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5a018e5-3a56-4b4b-8857-d6c55ecd2fb9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:59.862936 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5a018e5-3a56-4b4b-8857-d6c55ecd2fb9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:59.863630 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5a018e5-3a56-4b4b-8857-d6c55ecd2fb9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:54:59.864123 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5a018e5-3a56-4b4b-8857-d6c55ecd2fb9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:54:59.864551 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-e5a018e5-3a56-4b4b-8857-d6c55ecd2fb9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:54:59.995264 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.policy [None req-e5a018e5-3a56-4b4b-8857-d6c55ecd2fb9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127165) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:00.003737 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-e5a018e5-3a56-4b4b-8857-d6c55ecd2fb9 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1681 microversion: 2.1 time: 0.153691 Aug 24 16:55:00.004346 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 520/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:54:59 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:01.024795 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c7643ac5-ca12-49c7-812e-b19e6e9f36df tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:01.025431 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c7643ac5-ca12-49c7-812e-b19e6e9f36df tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:01.032156 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7643ac5-ca12-49c7-812e-b19e6e9f36df tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:01.033925 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7643ac5-ca12-49c7-812e-b19e6e9f36df tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:01.035014 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7643ac5-ca12-49c7-812e-b19e6e9f36df tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:01.035743 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7643ac5-ca12-49c7-812e-b19e6e9f36df tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:01.036180 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7643ac5-ca12-49c7-812e-b19e6e9f36df tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:01.036607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c7643ac5-ca12-49c7-812e-b19e6e9f36df tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:01.099175 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.policy [None req-c7643ac5-ca12-49c7-812e-b19e6e9f36df tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de20b3d10414699bec5a6eaf15f1aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec14f7fdaae43b68bc7113a7f17544b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127166) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 16:55:01.108374 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c7643ac5-ca12-49c7-812e-b19e6e9f36df tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 200 len: 1614 microversion: 2.1 time: 0.087336 Aug 24 16:55:01.108957 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 528/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:01 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:01.229234 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [req-3cd9c7cc-fc72-419b-9d68-0586d48a17fd req-fc1e0a9d-fe5d-47ae-8a8e-fb8a0c086fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42162a14-0745-4bae-8b2d-e049780948b6", "name": "network-vif-deleted", "tag": "aa982ba3-1613-4461-a621-81884a5f9f0f"}]} {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 16:55:01.242219 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-3cd9c7cc-fc72-419b-9d68-0586d48a17fd req-fc1e0a9d-fe5d-47ae-8a8e-fb8a0c086fa5 service nova] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:01.243392 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-3cd9c7cc-fc72-419b-9d68-0586d48a17fd req-fc1e0a9d-fe5d-47ae-8a8e-fb8a0c086fa5 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:01.243884 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [req-3cd9c7cc-fc72-419b-9d68-0586d48a17fd req-fc1e0a9d-fe5d-47ae-8a8e-fb8a0c086fa5 service nova] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:01.256778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.compute.server_external_events [req-3cd9c7cc-fc72-419b-9d68-0586d48a17fd req-fc1e0a9d-fe5d-47ae-8a8e-fb8a0c086fa5 service nova] Creating event network-vif-deleted:aa982ba3-1613-4461-a621-81884a5f9f0f for instance 42162a14-0745-4bae-8b2d-e049780948b6 on hv-cinder-77957 Aug 24 16:55:01.262559 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [req-3cd9c7cc-fc72-419b-9d68-0586d48a17fd req-fc1e0a9d-fe5d-47ae-8a8e-fb8a0c086fa5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036943 Aug 24 16:55:01.263239 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 521/1049] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 16:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 16:55:02.129576 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:02.130219 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:02.136714 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:02.137133 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:02.137569 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:02.138267 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:02.138719 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:02.139389 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:02.153614 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 HTTP/1.1 Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:55:02.155244 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:02.157101 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '42162a14-0745-4bae-8b2d-e049780948b6'} Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:02.158253 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:02.159895 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:02.161929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:02.161929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-a1c04d3d-abc8-459c-8efd-8ba569565dc4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 404 len: 111 microversion: 2.1 time: 0.031456 Aug 24 16:55:02.161929 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 529/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:02 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:02.167706 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-dd92342f-d2e6-49ac-b110-bea810ec68ac tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '.version_select at 0x7f063abab3a0>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:02.189695 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-dd92342f-d2e6-49ac-b110-bea810ec68ac tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-771505865" status: 202 len: 0 microversion: 2.1 time: 0.025289 Aug 24 16:55:02.190386 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 522/1051] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Aug 24 16:55:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-771505865 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 16:55:03.926029 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:03.926523 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:03.932864 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:03.933345 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:03.933780 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:03.934464 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:03.934917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:03.935337 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:03.949161 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: DELETE /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 HTTP/1.1 Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:55:03.950666 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:03.952338 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '42162a14-0745-4bae-8b2d-e049780948b6'} Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:03.953276 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:03.955493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:03.957117 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:03.957117 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-da1a7632-0769-401e-b743-698f77d16db4 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 404 len: 111 microversion: 2.1 time: 0.030332 Aug 24 16:55:03.957117 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 530/1052] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:55:03 2022] DELETE /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:03.961571 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:03.962307 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 42162a14-0745-4bae-8b2d-e049780948b6] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:03.969392 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:03.970032 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:03.970478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:03.971211 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:03.971674 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:03.972130 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:03.985048 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 HTTP/1.1 Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:55:03.987345 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:03.989088 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '42162a14-0745-4bae-8b2d-e049780948b6'} Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:03.989999 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. Aug 24 16:55:03.991504 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:03.992950 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance 42162a14-0745-4bae-8b2d-e049780948b6 could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:03.992950 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-15a16a41-3ac8-45ce-8481-64cb5bd9a542 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6" status: 404 len: 111 microversion: 2.1 time: 0.031027 Aug 24 16:55:03.992950 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 523/1053] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:03 2022] GET /compute/v2.1/servers/42162a14-0745-4bae-8b2d-e049780948b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:05.128357 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:05.128883 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:05.135132 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:05.135615 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:05.136096 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:05.136789 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:05.137239 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:05.137664 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:05.150757 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: DELETE /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e HTTP/1.1 Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:55:05.152305 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:55:05.153917 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': '317ed219-9de0-434f-9325-dc2b2af77b5e'} Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:05.154842 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:55:05.156398 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.158934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:05.158934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-c848d02a-13f5-4751-b8b1-4269ac76dd70 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 404 len: 111 microversion: 2.1 time: 0.029359 Aug 24 16:55:05.158934 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 531/1054] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:55:05 2022] DELETE /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:05.162442 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:05.163057 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: 317ed219-9de0-434f-9325-dc2b2af77b5e] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:05.169095 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:05.169586 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:05.170032 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:05.170726 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:05.171182 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:05.171609 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:05.185197 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e HTTP/1.1 Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:55:05.186702 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:55:05.188361 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': '317ed219-9de0-434f-9325-dc2b2af77b5e'} Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:05.189799 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. Aug 24 16:55:05.191334 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.192767 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance 317ed219-9de0-434f-9325-dc2b2af77b5e could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:05.192767 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-ad1e54fc-a81c-412e-93ed-8bdb980c3e88 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e" status: 404 len: 111 microversion: 2.1 time: 0.029454 Aug 24 16:55:05.192767 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 524/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:05 2022] GET /compute/v2.1/servers/317ed219-9de0-434f-9325-dc2b2af77b5e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:05.196493 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:05.197018 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:05.202957 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:05.203440 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:05.203873 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:05.204626 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:05.205071 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:05.205529 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:05.218446 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: DELETE /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb HTTP/1.1 Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:55:05.220641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:55:05.222272 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'e5453b93-7b3d-485c-850c-5852e89aeecb'} Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:05.223158 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:55:05.224835 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.226603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:05.226603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-e7f7fcff-3b03-4d1b-a763-db1919df6edd tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 404 len: 111 microversion: 2.1 time: 0.029332 Aug 24 16:55:05.226603 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 532/1056] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:55:05 2022] DELETE /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:05.230182 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:05.230793 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: e5453b93-7b3d-485c-850c-5852e89aeecb] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:05.237370 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:05.237854 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:05.241463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:05.241463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:05.241463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:05.241463 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:05.253682 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb HTTP/1.1 Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:55:05.255324 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:55:05.256962 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'e5453b93-7b3d-485c-850c-5852e89aeecb'} Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:05.260171 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. Aug 24 16:55:05.261778 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:05.263138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance e5453b93-7b3d-485c-850c-5852e89aeecb could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:05.263138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-b4159b7e-d696-44b6-b5f5-ab04eed170bc tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb" status: 404 len: 111 microversion: 2.1 time: 0.030285 Aug 24 16:55:05.263138 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 525/1057] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:05 2022] GET /compute/v2.1/servers/e5453b93-7b3d-485c-850c-5852e89aeecb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 16:55:06.401996 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:06.402500 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.compute.api [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127166) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:06.409923 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:06.410403 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:06.410836 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:06.411525 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:06.411998 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:06.412420 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG oslo_concurrency.lockutils [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:06.425997 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.wsgi [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: request: DELETE /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee HTTP/1.1 Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept: application/json Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Accept-Encoding: identity Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Connection: close Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Length: 0 Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Content-Type: application/json Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Host: 10.222.0.52 Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Openstack-System-Scope: None Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Id: None Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Domain-Name: None Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Identity-Status: Confirmed Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Is-Admin-Project: True Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Id: default Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Domain-Name: Default Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Role: reader,member Aug 24 16:55:06.427506 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Roles: reader,member Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Id: default Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Domain-Name: Default Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: method: > Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: exception: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:55:06.429160 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: action_args: {'id': 'b89e22b2-b09c-48ff-9378-fba95e34a7ee'} Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: {{(pid=127166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:06.430052 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:55:06.431321 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: ERROR nova.api.openstack.wsgi Aug 24 16:55:06.432607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: DEBUG nova.api.openstack.wsgi [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. {{(pid=127166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:06.432607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO nova.api.openstack.requestlog [None req-72e9852c-30f2-4c50-8ac6-979a97f69291 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 404 len: 111 microversion: 2.1 time: 0.030697 Aug 24 16:55:06.432607 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: [pid: 127166|app: 0|req: 533/1058] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 16:55:06 2022] DELETE /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:06.437234 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Calling method '>' {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 16:55:06.437841 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.compute.api [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] [instance: b89e22b2-b09c-48ff-9378-fba95e34a7ee] Fetching instance by UUID {{(pid=127165) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 16:55:06.444426 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:06.444906 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:06.445337 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:06.446022 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Acquiring lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 16:55:06.446475 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 16:55:06.446896 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG oslo_concurrency.lockutils [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Lock "be07c2cf-28a6-420b-a09a-b6459fa4f88c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 16:55:06.460406 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.wsgi [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] HTTP exception thrown: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Request method failure captured: Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: request: GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee HTTP/1.1 Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept: application/json Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Accept-Encoding: identity Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Connection: close Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Length: 0 Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Content-Type: application/json Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Host: 10.222.0.52 Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Openstack-System-Scope: None Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: User-Agent: python-urllib3/1.26.11 Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Auth-Token: gAAAAABjBlbt-dI57sU5uU63QUq9lqsdPr6Lfn1plHhH77y3oPr8EYyndoTW7UT9QkseQ7YLPTN8kJokEmnSHhTgJeIEg26bjIoijsgagrC2lYDe5TTktn0r7Lc5vkCtzDDD5QGbNyiUq0lSSoRyUR5n_yyY4kROeDFOtzYLoUDbV_5TSMzr_z8 Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Id: None Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Domain-Name: None Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Identity-Status: Confirmed Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Is-Admin-Project: True Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Id: default Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Domain-Name: Default Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Project-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Role: reader,member Aug 24 16:55:06.461899 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Roles: reader,member Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eec14f7fdaae43b68bc7113a7f17544b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eec14f7fdaae43b68bc7113a7f17544b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Id: eec14f7fdaae43b68bc7113a7f17544b Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-262648807 Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Id: default Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Domain-Name: Default Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Id: 0de20b3d10414699bec5a6eaf15f1aa3 Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: X-User-Name: tempest-AttachVolumeNegativeTest-262648807-project Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: method: > Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: exception: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:55:06.463555 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: action_args: {'id': 'b89e22b2-b09c-48ff-9378-fba95e34a7ee'} Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: {{(pid=127165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 16:55:06.464491 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. Aug 24 16:55:06.466001 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: ERROR nova.api.openstack.wsgi Aug 24 16:55:06.467478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: DEBUG nova.api.openstack.wsgi [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] Returning 404 to user: Instance b89e22b2-b09c-48ff-9378-fba95e34a7ee could not be found. {{(pid=127165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 16:55:06.467478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO nova.api.openstack.requestlog [None req-0bd97be5-b3db-45dc-bc09-4295f40d1b02 tempest-AttachVolumeNegativeTest-262648807 tempest-AttachVolumeNegativeTest-262648807-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee" status: 404 len: 111 microversion: 2.1 time: 0.029845 Aug 24 16:55:06.467478 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: [pid: 127165|app: 0|req: 526/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 16:55:06 2022] GET /compute/v2.1/servers/b89e22b2-b09c-48ff-9378-fba95e34a7ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 16:56:06.851112 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:56:06.851821 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Wed Aug 24 16:56:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:56:13.759341 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:56:13.760035 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Wed Aug 24 16:56:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:56:56.522136 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:56:56.522961 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Wed Aug 24 16:56:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:57:48.154500 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:57:48.155062 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Wed Aug 24 16:57:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:58:07.136760 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:58:07.137376 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Wed Aug 24 16:58:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:58:07.277185 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:58:07.277641 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Wed Aug 24 16:58:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:59:26.859387 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:59:26.860025 dv-cinder-779578-5-iscsi devstack@n-api.service[127165]: Wed Aug 24 16:59:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:59:33.767662 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:59:33.768417 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Wed Aug 24 16:59:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 17:00:16.530843 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 17:00:16.531551 dv-cinder-779578-5-iscsi devstack@n-api.service[127166]: Wed Aug 24 17:00:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!